Matillion Calling a Python Script file on Network

Question

Is it possible for an "orchestrated job" to call a python file code on a network where it is all ready working?

I have this line that is not working in Matillion:

call(["python", "r'//caid-fs02/Python Work/data.py"])

I get this error:

Traceback (most recent call last):
  File "/tmp/interpreter-input-8418eaf0-9ef7-4d99-a0fd-7cb519c67759.tmp", line 19, in <module>
    call(["python", "r'//caid-fs02/Python Work/data.py"])
NameError: name 'call' is not defined
Script failed with status: 1

Possibly helpful or related How to call a script from another script? — chickity china chinese chicken
– chickity china chinese chicken, Commented Oct 12, 2023 at 20:28

peterb · Accepted Answer · 2023-10-12 20:51:35Z

0

Assuming that the network path is on the Matillion VM, in the python script component in your orchestration job, you can use:

import subprocess
subprocess.run(["python", "r'//caid-fs02/Python Work/data.py"])

Otherwise, you would need to use the python paramiko library to upen an SSL connection to the server where the script resides:

import paramiko
client = paramiko.SSHClient()
client.connect(hostname=hostname, username=username, password=password)
client.exec_command("python", "r'//caid-fs02/Python Work/data.py")

answered Oct 12, 2023 at 20:51

peterb

7373 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

mekcox Over a year ago

As a novice to Matillion I am getting this error when I use the import subprocess on line 14: line 14: import: command not found Script failed with status: 127 Should I be have a pre line code or installation of of library. I use the Matallion to login to create this job. Any advice?

Maran · Accepted Answer · 2023-12-26 22:22:54Z

0

I'm not clear on the question. Based on the assumptions you wanted to call a python script from Matillion Orchestration which is available in backend Matillion VM. To call a python script from Bash component. You will have to install python on the VM where Matillion is hosted if you're using dedicated VM for Matillion. Then deploy your python script into any common path for scripts and call the script from Bash component as below

python <path_to_script>/data.py "arg if any"

More details can be found here - https://metlcommunity.matillion.com/s/question/0D54G00008ZwIUgSAN/how-to-execute-a-python-script

answered Dec 26, 2023 at 22:22

Maran

1811 gold badge7 silver badges23 bronze badges

Collectives™ on Stack Overflow

Matillion Calling a Python Script file on Network

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related