Skip to main content
69 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
1 vote
1 answer
134 views

We are using Amazon Redshift Serverless as our primary database, with a maximum of 8 RPUs. To optimize costs, we recently reduced the idle session timeout from the default of 1 hour down to 10 minutes....
Graziano Fuccio's user avatar
  • 11
1 vote
0 answers
156 views

I want to invoke execute_statement API of Redshift Serverless with a create user statement like CREATE USER "john" PASSWORD 'johnDoe1';. However, when I do this via Python script (or ...
shiva's user avatar
  • 2,781
0 votes
1 answer
94 views

I've created a Copy job using the following: COPY public.test_table FROM 's3://<s3_bucket>/<table_prefix> IAM_ROLE '...' format as csv IGNOREHEADER 1 JOB CREATE copy_test_delete_me AUTO ON ...
TobyStack's user avatar
  • 331
0 votes
0 answers
52 views

I'm trying to create an endpoint for a Redshift serverless cluster in a different account, I granted access to it to the new account and in the form for creating the endpoint (see image I can see in ...
inet123's user avatar
  • 812
0 votes
2 answers
89 views

I wrote a stored procedure that calls other procedures inside multiple transaction blocks (BEGIN…END) with their own error handlers. I expected that if one block encounters an exception, it would go ...
Josedc8's user avatar
  • 1
0 votes
2 answers
950 views

I am trying out Redshift and at first, I am trying to access queries I ran in the past but was hit by this error: ERROR: permission denied for relation stl_query and tried to grant access as well but ...
Visrut's user avatar
  • 762
0 votes
1 answer
153 views

I am re-writing some 1000+ line queries which were written originally for a PostgreSQL DB and now have to run on near-identical data in Redshift (using Redshift Serverless and the QueryEditorV2). This ...
Indoordinosaur's user avatar
  • 127
1 vote
1 answer
78 views

I am trying to load data into Redshift from a DynamoDB table. The table includes nested fields which does not get fetched correctly. The data inside the DynamoDB has structure like "Status": ...
Svante Allgulander's user avatar
  • 11
1 vote
1 answer
141 views

I have a parquet file which I need to load into Redshift. I'm using COPY command to do that. But there are also other columns in the table which needs to have values inserted along with the COPY ...
Poreddy Siva Sukumar Reddy US's user avatar
  • 15
0 votes
0 answers
167 views

I have S3 bucket which contains parquet files which are not more than 20 MB in size (all parquets combined). I'm loading these files into AWS Redshift serverless tables using COPY command. But after ...
Poreddy Siva Sukumar Reddy US's user avatar
  • 15
0 votes
1 answer
93 views

I have an S3 bucket which contains parquet files. I need to analyse that parquet file and create the required table in Redshift serverless. import pyarrow.parquet as pq df = pq.read_table(f"s3://{...
Poreddy Siva Sukumar Reddy US's user avatar
  • 15
0 votes
2 answers
364 views

I want to grant access to my Redshift Serverless workgroup so other specified accounts to create Redshift-managed VPC endpoints. In the workgroup view in the console, it looks like it is an attribute ...
nickklon's user avatar
  • 126
0 votes
1 answer
175 views

I have an S3 bucket which contains 1000s of folders which are basically table_names and those contains parquet files. I'm trying to create tables with that schema in redshift. I'm using redshift-data ...
Poreddy Siva Sukumar Reddy US's user avatar
  • 15
0 votes
1 answer
528 views

I am trying to schedule a query in redshift serverless using query scheduler v2. I have created a role copy-s3-to-redshift, with permissions as AmazonEventBridgeFullAccess ...
Ruchir Patil's user avatar
  • 3
0 votes
1 answer
102 views

I have a scheduled task that calls a stored procedure in a Redshift database. If I execute it manually, it works fine, only the scheduled is failing, but I'm not able to see WHY the query is failing. ...
Celia's user avatar
  • 21
0 votes
2 answers
261 views

I have a very simple Glue job loading data from S3 to Redshift, with a Transform in between to rename fields and change their types: First execution runs (almost) without issues - data gets loaded ...
Michał Malus's user avatar
  • 71
5 votes
3 answers
3k views

I am trying to use Redshift Query Editor V2 authenticating via IAM Identity Center. These were my setup steps: Created IAM Identity Center in the same region as the Serverless Workgroup Created a ...
ETisREAL's user avatar
  • 176
0 votes
2 answers
81 views

I consider a row duplicate when the combination of hash_key and load_date is repeating. I can find such rows using this CTE: with w_duplicated_rows as ( select hash_key, load_date, count(*), --...
x89's user avatar
  • 3,532
0 votes
0 answers
695 views

I am using .NET 6.0 with Visual Studio + AWS Explorer plugin that has my credential saved. I created a simple table consisting of first name and last name. create table name( firstname varchar(200), ...
hubertcyNinja's user avatar
  • 13
0 votes
0 answers
144 views

I am new to data engineer and I try to load 3 data tables from RDS into Redshift using AWS Glue. 3 tables in RDS only have maximum size over 100Mb. But when I load data using Glue (or copy command in ...
Jian_'s user avatar
  • 1
0 votes
1 answer
2k views

I have a simple table in redshift with the below schema: Column | Type | Collation | Nullable | Default -----------------+-----------------------------+-----------+---...
user1468899's user avatar
  • 77
0 votes
2 answers
707 views

I hope you are doing well, I am working on aggregating data by month, Note: I am querying data from Redhsift using Metabase. This is my query: (SELECT dataset.value AS value, TO_CHAR(...
Vishal Poojary's user avatar
  • 1
1 vote
1 answer
502 views

I'm trying to drop a group from my redshift cluster. drop group conform_main_prtest_admin_dev; This command give me the error, ERROR: group "conform_main_prtest_admin_dev" cannot be dropped ...
Prathyush Peettayil's user avatar
  • 425
0 votes
1 answer
1k views

I have a Redshift Serverless database that I need to delete. When I run the command: drop database [my_database_name] an error is returned: SQL Error [55006]: ERROR: database "[my_database_name]...
gbeaven's user avatar
  • 1,830
0 votes
1 answer
1k views

I am trying to connect to a Redshift serverless db I created on AWS using local python code. The db has data, and I can query it using query editor v2, however I am having issues connecting to it in ...
KajZ's user avatar
  • 23
0 votes
0 answers
93 views

I have a lambda function which uses below code to list redshift serverless workgroups. client = boto3.client("redshift-serverless") res = client.list_workgroups() I have configured local ...
Prathyush Peettayil's user avatar
  • 425
0 votes
1 answer
159 views

I have fixed the width file with a unit separator.All records are in one row separated by a unit separator(US). This file has no header(no column names) but the header and trailer.I tired with the ...
user2104898's user avatar
  • 1
1 vote
2 answers
2k views

I am using AWS Glue to migrate data from Glue Catalog to Redshift Serverless and S3 after some transformations. Since, I am learning Glue, I am using the Redshift Serverless to save my money. So, I ...
pc_fuel's user avatar
  • 786
1 vote
0 answers
511 views

I am trying to run queries on AWS Glue Data Catalog as a Federated user from Python script in Lambda, but I am facing the issues: The first issue - I cannot find appropriate way to connect as ...
bytebridger's user avatar
  • 23
2 votes
0 answers
194 views

The AWS::RedshiftServerless::Workgroup Cloudformation spec does not have a VPC property, but it has subnets and security groups: Example: RedshiftServerlessNamespace: Type: AWS::RedshiftServerless::...
user602525's user avatar
  • 3,264
0 votes
0 answers
707 views

Can anyone share a basic template to create redshift serverless cluster. It include creating namespace, workgroup. I tried with following template however it's giving error as At least one Resources ...
Shiv Suthar's user avatar
  • 11
1 vote
1 answer
599 views

I shared a Redshift snapshot from Account A to Account B. When I try to restore the snapshot in Account B, I am getting an AccessDenied exception stating that no resource policy can be found: The ...
Alexander Sweeney's user avatar
  • 341
2 votes
0 answers
831 views

I am relatively new to Redshift Serverless. My goal is to perform ETL tasks on data currently stored in S3 and available in the Glue Data Catalog. I can see the 'awsdatacatalog' schema in query editor ...
bdani's user avatar
  • 21
0 votes
1 answer
192 views

Problem: The query below worked fine a few days ago and took only a few seconds to execute (it's only 20 small JSON files). However, now it times out after 45min. I haven't touched redshift or the ...
gebbissimo's user avatar
  • 2,769
0 votes
1 answer
2k views

Given a Redshift serverless cluster and a dummy_table, when trying to connect to it in the AWS Cloudshell using aws redshift-data execute-statement --endpoint-url https://default.XXXXXXXXX.eu-central-...
gebbissimo's user avatar
  • 2,769
0 votes
0 answers
1k views

I have a question about cross database referencing in a Redshift cluster that we are doing a POC on. The basic question is, is it possible to do an insert from a connection on one database in the ...
Captive's user avatar
  • 1
1 vote
0 answers
157 views

My fundamental question is, how to debug a UDF in Redshift serverless environment? SQL clients suggest to use svl_udf_log but I do not find that.
Sreekanth's user avatar
  • 1,947
1 vote
0 answers
188 views

I have a redshift serverless workgroup (not public) that I can connect to from powerBI using the AWS generated redshift workgroup URL. However I want to provide a easy to remember URL to everyone to ...
Vasu's user avatar
  • 1,130
0 votes
1 answer
534 views

I have a process that runs VACUUM manually on a list of redshift tables on a daily basis to maintain consistent query performance. But sometimes, vacuuming one table takes about 2 hours. Is this ...
thox's user avatar
  • 169
-1 votes
1 answer
2k views

I want to do continuous file ingestion from Amazon S3 to AWS Redshift, but the Auto Job copy doesn't work. COPY "prueba 8" FROM 's3://xxxxxxxxxxxx' IAM_ROLE 'xxxxxxxxxxxxxxxxxxxxxxxxxx' ...
Numpy's user avatar
  • 1
0 votes
2 answers
917 views

I have account A with AWS Redshift Serverless namespace and workgroup. The workgroup is not public accessable. I want to connect from AWS account B to the namespace on account A. How is that possible? ...
Shkolar's user avatar
  • 422
0 votes
1 answer
2k views

Can provisioned Redshift clusters and Serverless Redshift clusters share data when they are in the same region and under the same account? I created a data share in the provisioned Redshift cluster ...
김재민's user avatar
  • 13
1 vote
1 answer
3k views

I'm using a Python script to read a CSV file using Pandas, add some metadata columns to it, generate a parquet file and finally COPY it into Redshift Serverless. However, Redshift Serverless complains ...
ankush981's user avatar
  • 5,437
0 votes
1 answer
403 views

I have a problem when I try to run Redshift query from a AWS lambda function by using the AWS sdk @aws-sdk/client-redshift-data. I have a Redshift serverless cluster. This error is returned: Error: ...
remi0291's user avatar
  • 13
1 vote
2 answers
2k views

I am trying to understand pricing for Redshift Serverless but slightly confused between compute_seconds and charged_seconds. I have currently set base RPU to 128 which is the default. I have have ...
opensource-developer's user avatar
  • 3,140
3 votes
1 answer
522 views

We have Multi-tenancy application where we have separate database for each client in MongoDB, PostgreSQL & separate Index in ElasticSearch. Now we are planning for Datawarehouse to be created in ...
Manish Joisar's user avatar
  • 1,340
1 vote
1 answer
1k views

I created a datashare in Serverless cluster. Now I want to add that datashare in Provisioned cluster. Simplest way is to create a new database using below command. CREATE DATABASE temp_db FROM ...
kgupta's user avatar
  • 77
0 votes
1 answer
2k views

We are trying to use redshift serverless. It shows the query history is stored in the table sys_query_history. But looking at the table, the query_text field has a 4000 characters limit. They'd ...
lucky_start_izumi's user avatar
  • 2,611
1 vote
0 answers
597 views

I have tried to run the following SQL query in Amazon Redshift serverless many times now and it keeps failing: with ssr as (select s_store_id, sum(sales_price) as sales, sum(profit) ...
Phil's user avatar
  • 21
1 vote
1 answer
3k views

Been banging my head on this for a while now. I have an AWS Redshift Serverless Workspace set up. I have loaded data to a table and am able to query it using the AWS browser tool. Using the AWS CLI, I ...
reenrik's user avatar
  • 81

1
2