Skip to main content
86 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
0 answers
55 views

My goal is to: Extract email attachments (for example: images, PDF, or CSV files). Store those attachments into a Snowflake internal stage so that they can be processed later. I was able to set up the ...
pradip patil's user avatar
  • 11
0 votes
0 answers
90 views

I have the following python code in my Matillion PythonScript component: from office365.sharepoint.client_context import ClientContext from office365.runtime.auth.authentication_context import ...
David Makovoz's user avatar
  • 1,938
0 votes
1 answer
199 views

I am new to Matillion while creating an orchestration pipeline i am getting a validation error Environment connection creation failed: JDBC driver encountered communication error. Message: HTTP status=...
Anubhav sharma's user avatar
  • 21
0 votes
1 answer
208 views

I am using Matillion Task History API to fetch the history of tasks that have been running in the Matillion ETL instance. Task history results are subject to a limit of 1,000 records for a single task ...
Rafiul Sabbir's user avatar
  • 636
0 votes
1 answer
140 views

I am new to the API world and have a question. I am currently making an API custom connector call to plytix with Matillion Data Loader. The call works fine until I want to bring in all the records ...
user26426873's user avatar
  • 1
0 votes
1 answer
78 views

I have a query as: select count(distinct sfdc_account_id), from account union select count(distinct account_id), from fct_acco I want to know if both counts from above query are same or not? ...
asd's user avatar
  • 303
0 votes
1 answer
144 views

I am using JIRA token to read data into matiilion and send it to snowflake. I can see all tables except for "form" data. How to get this data or which table has this data?
Xi12's user avatar
  • 1,263
0 votes
1 answer
78 views

I want to delete multiple tables, and the table names are in the grid variable. for example [['table_1'], ['table_2']]. But when I define the grid variable, it says input required.
Junth's user avatar
  • 27
0 votes
1 answer
93 views

I am using salesforce increment query to load data into snowflake using matillion. But when I do a select dictinct isdeleted from from table. I always get False How to get deleted records from ...
Xi12's user avatar
  • 1,263
0 votes
1 answer
106 views

How to fetch data from API_2 which needs the authentication session from another POST API in API Query Profile? Suppose I have an API_2 which can only extract data when it has access from the ...
Prachetas's user avatar
  • 1
0 votes
1 answer
209 views

I was wondering if it is possible to centrally manage Python scripts in Matillion. I envision that a Python component I need in multiple Matillion pipelines (on multiple instances) can be managed with ...
maarten442's user avatar
  • 1
0 votes
2 answers
210 views

Is it possible for an "orchestrated job" to call a python file code on a network where it is all ready working? I have this line that is not working in Matillion: call(["python", &...
mekcox's user avatar
  • 1
0 votes
1 answer
313 views

I am trying to load data from dynamo Db to snowflake using matillion (DynamoDB Query Compoenent) Our client Matillion is hosted on one AWS account(XYZ) and Dynamo DB is in another Aws account(ABC). I ...
Raghu's user avatar
  • 27
-1 votes
1 answer
2k views

I'm working in Matillion/Snowflake and stuck on some REGEXP functions. I have a varchar field with a few entries containing letters and hyphens and looking for a way to make any field contains letters ...
Pray4Tre's user avatar
  • 5
0 votes
1 answer
1k views

I am trying to load data to a snowflake table using Matillion Database Query component. It gives the error "Error Max LOB size (16777216) exceeded, actual size of parsed column is xxx" while ...
Sreekanth Mohan's user avatar
  • 348
0 votes
1 answer
336 views

I am managing an AWS instance of Matillion ETL for a client. They have no real IT or AWS engineers, and I am not experienced as an AWS admin. Following Matillion instructions, I installed the AMI with ...
Cgr's user avatar
  • 11
0 votes
1 answer
608 views

I'm trying to execute Snowflake Stored Procedure in Matilion Using Sql Script component. But i'm getting error as Unknown user defined function. Can someone help me to call the procedure using ...
sagyy_sf's user avatar
  • 45
0 votes
1 answer
480 views

I am trying to launch a Matillion ETL instance through AWS and keep getting the error below ERROR: This site can’t be reached amazonaws.com took too long to respond ec2-34-226-233-122.compute-1....
samthecodegod's user avatar
  • 53
0 votes
1 answer
248 views

I am trying to set a string variable with the following format "YYYY-MM-DD HH:MM:SS" as a column value in Matillion with an SQL script component. My initial code was this: UPDATE "...
brenda's user avatar
  • 813
0 votes
1 answer
451 views

I'm a new Matillion user so suspect I'm overlooking an obvious answer... I am currently reading a number of identically formatted tables (yearly sales data) and vertically stacking them using a Unite ...
Dave-C's user avatar
  • 55
0 votes
1 answer
435 views

I have an SQS queue that receives a message with the file name that has been created in a target bucket. The process to send the message is: csv file is inserted into target_bucket. A message is sent ...
brenda's user avatar
  • 813
1 vote
0 answers
221 views

I am trying to move the GA4 data of two websites from BigQuery to a Snowflake table using Matillion ETL. BigQuery tables are named events_YYYYMMDD format. The query I am using in the Matillion ...
Sreeraj's user avatar
  • 314
0 votes
1 answer
243 views

I have the following folder hierarchy in an S3 bucket: January/10 16b516c0-8f2a-eabd-770a-b8bbc83c5859.csv, 16b516c0-8f2a-eabd-770a-b8bbc83c5859.csv, … In other words, every folder represents a ...
Victor Sotnikov's user avatar
  • 305
0 votes
1 answer
733 views

I'm loading merge excel cells using Matilion into Snowflake table. After loading into SF table, I'm trying to replace all nulls with the first column value. Below is the input data I/p: Expected O/P: ...
sagyy_sf's user avatar
  • 45
0 votes
0 answers
44 views

I am unable to create a pipeline to get data from Facebook Content Insights to Snowflake. I have generated the page access token from Facebook graph explorer & added that as a parameter- "...
Vanessa D'souza's user avatar
  • 1
0 votes
1 answer
909 views

I am going through Matillion Academy (Building a Data Warehouse). There is a slide deck to follow online and I am running my own instance of Matillion to recreate the building of the warehouse. My ...
Dieter VH's user avatar
  • 3
0 votes
1 answer
646 views

I am looking for a way in Informatica to pull data from a table in a database, load it in Snowflake, and then move on to the next table in that same DB and repeating that for the remaining tables in ...
Perdue's user avatar
  • 489
0 votes
1 answer
91 views

So currently there are 2 user with similar id (one without space, other with space) in their ID. So I want to delete the user(other with space) but when I run the Delete Curl command it's not ...
tannu kumari's user avatar
  • 1
1 vote
0 answers
363 views

The schema of one of the databases that is connected to our business Intelligent data warehouse is constantly evolving (CICD), consequently Each time a change occurred, we need to manually update the ...
ryan's user avatar
  • 101
0 votes
1 answer
1k views

If I create an environment variable in a Matillion called "var_foo" (with a Type of "Text", a Behaviour of "Shared" and a default of "notset") I'm able to set ...
FreeZey's user avatar
  • 2,862
0 votes
2 answers
343 views

enter image description hereI have two components on a canvas in Matillion. The instructions are to "use my mouse to connect the two components". I am unable to connect them. I can drag them,...
HilaryKoerner's user avatar
  • 61
0 votes
1 answer
224 views

I am going through Matillion Academy (Building a Data Warehouse). There is a slide deck to follow online and I am running my own instance of Matillion to recreate the building of the warehouse. I have ...
HilaryKoerner's user avatar
  • 61
0 votes
1 answer
654 views

I have an Orchestration job running in which I am using an iterator component. I have created a job variable which is reading filename for the iterator. Is their any way to store the variable value (i....
shiv.r's user avatar
  • 1
0 votes
1 answer
1k views

I am trying to connect Snowflake to Matillion ETL using key-pair authentication. I'm facing the error 'Default Database must not be empty'. We have given a default database from Snowflake side as well....
Meghnaa Jaiswal's user avatar
  • 1
0 votes
1 answer
350 views

This is the code I wrote in SSMS which works fine for my purposes however trying to use the same principles with Matillion (yes I have to use Matillion at my company) I am still getting duplicate ...
Anomaly's user avatar
  • 43
0 votes
2 answers
1k views

Need to send email with Attachment from Matillion Tool I have checked SNS Message,Send Email component from Matillion but it does not have attachment option. I have Error log table into Amazon ...
Satis Chaudhar's user avatar
  • 1
0 votes
1 answer
5k views

I've installed python3 and boto3, and i want to run my python script from Matillion but it complains about boto3 module not being available: Traceback (most recent call last): File "/tmp/...
alterego's user avatar
  • 352
0 votes
1 answer
681 views

I have a use case where I am Transferring XML files from Windows fileshare to Azure Blob Storage and then loading data to Snowflake Tables. I am using Matillion to achieve this. The Windows Fileshare ...
shiv.r's user avatar
  • 1
1 vote
1 answer
1k views

so there have been a bunch of similar questions, though I haven't managed to find the answer in any of them, so here we are. I'm trying to pull some data from the Facebook API using Python, and at ...
H8oddo's user avatar
  • 133
0 votes
1 answer
531 views

We are using Matillion ETL API to pass query parameters to the underlying Redshift query. A query parameter variable for States is created using concatenation from the dropdown list and passed in the ...
Gaurav S's user avatar
  • 1,009
2 votes
3 answers
1k views

We're running Matillion (v1.54) on an AWS EC2 instance (CentOS), based on Tomcat 8.5. We have developped a few ETL jobs by now, and their execution takes quite a lot of time (that is, up to hours). We'...
dovregubben's user avatar
  • 464
0 votes
1 answer
937 views

I am trying to add sso for matillion using okta. I am following below blog. But I am stuck with this error. Is there any way to trouble shoot this. This is my error. Your request resulted in an error. ...
Guru's user avatar
  • 21
0 votes
1 answer
1k views

I've launched a new AWS EC2 instance (m5.large) based on Matillion's latest AMI (Matillion v1.56.9). The instance is coming up fine and I can reach Matillion's login page at https://[internal IP], but ...
dovregubben's user avatar
  • 464
0 votes
2 answers
546 views

New Matillion user, and my first project is to read in Google Analytics data by using a google account authorized to access GA data from several clients. I follow the steps from this Matillion ...
Cgr's user avatar
  • 11
1 vote
1 answer
672 views

I want to perform incremental load from Azure Blob storage to Snowflake table using Matillion ETL. There is a JDBC incremental load component but it works for a select few databases and Snowflake isn'...
Coder1990's user avatar
  • 111
1 vote
1 answer
2k views

I want to get files from Azure Blob storage and use Matillion ETL tool to write them to Snowflake table. In Matillion, the default is coming as AWS. Very little documentation is available for Azure. ...
Coder1990's user avatar
  • 111
-1 votes
2 answers
498 views

Is it possible to load data from S3 to SQL Server using Matillion ETL tool?
Kunal Patel's user avatar
  • 1
0 votes
1 answer
106 views

Marketo Activity object API's missing High Watermark / Audit Fields. What is the potential way to identify changed records using UpdatedAt or ModifedDate like columns. None of the Activity Objects ...
Rajdeep's user avatar
  • 1
0 votes
1 answer
547 views

We are trying to use the Marketo Activity Bulk Extract API to get Activities within a certain date range. However, there doesn't seem to be a high watermark (updatedAt, lastModifiedDate etc) filter ...
Saqib Ali's user avatar
  • 4,551
1 vote
2 answers
4k views

Snowflake doesn't accept T-sql but i'm trying to Create schema If it doesn't exists. IF NOT EXISTS (SELECT * FROM SYS.SCHEMA WHERE NAME = 'CBS') CREATE SCHEMA 'CBS'; How to do this in ...
user1810575's user avatar
  • 831

1
2