1,647 questions
3
votes
2
answers
75
views
Autovacuum causing deadlocks with ALTER TABLE RENAME on Aurora PostgreSQL 14
I'm working with COTS software, so changing the software is difficult.
The software has a process:
Creates a temporary table
Adds a bunch of data
When finished, renames the table
ALTER TABLE ...
- 1,269
1
vote
0
answers
24
views
How to capture IAM user identity in Aurora MySQL audit logs when connecting through AWS TEAM elevated access?
I’m using TEAM elevated access for AWS in my organization to temporarily access an Aurora MySQL cluster.
TEAM provides database access through a tunneled MySQL session using a generic database ...
1
vote
1
answer
85
views
Different versions of pg_stat_statements on different databases on the same instance?
I'm writing some code to capture some query info in aurora postgres. When I take data from pg_stat_statements view from 3 different databases, I can see different columns returned.
Turns out the ...
- 86
0
votes
1
answer
61
views
MySQL Aurora slow COUNT query
I have a COUNT(*) query that is really fast in several DB's, but is really slow on MySQL AURORA:
I can't seem to figure out why. First I thought it was because it went the MEMORY went over the 4MB, ...
- 466
0
votes
1
answer
97
views
Query performance degradation under multiple concurrent requests
Environment:
Database: AWS Aurora MySQL (8.0)
connector: software.aws.rds,aws-mysql-jdbc || software.amazon.jdbc,aws-advanced-jdbc-wrapper
Application: Spring Boot (3.5.0)
Java Version: 21
I'm ...
4
votes
2
answers
172
views
Catastrophic query planning, non-use of index in MySQL 8+
I have a legacy Drupal 7 site that is used strictly internally. It's replacement is under active development, but in the meantime it is using Aurora2, MySQL 5.7 compatible and is in very expensive ...
- 549
0
votes
1
answer
435
views
Why do the pg_temp_### and pg_toast_temp_### schemas keep growing, and why are they not being dropped or released automatically?
We've observed a significant number of temporary schemas with names like pg_temp_* and pg_toast_temp_* accumulating in both the Sandbox and Dev environments.
Why do the pg_temp_### and pg_toast_temp_##...
0
votes
0
answers
183
views
Spring Boot with mariadb-java-client, AWS JDBC Wrapper, and HikariCP: PreparedStatement executeBatch Only Works with Single Statement in Batch
I have a Spring Boot application that connects to an Amazon Aurora MySQL-compatible database. The setup uses the MariaDB JDBC driver, the AWS JDBC wrapper, and HikariCP for connection pooling.
My code ...
- 168
-1
votes
1
answer
128
views
INSERT INTO @Tbl issue on Babelfish for Aurora PostgreSQL with SQL Server Compatibility (Babelfish 4.4.0)
DECLARE @Tbl TABLE
(
ID bigint,
Seq bigint identity(1,1)
)
DECLARE @sqltest nvarchar(max);
SET @sqltest = 'SELECT 1';
INSERT INTO @Tbl (...
1
vote
0
answers
102
views
Replication: new Aurora MySQL read replicas aren’t picked up by TypeORM after autoscaling
Environment
TypeORM: 0.3.20
@nestjs/typeorm: 10.0.2
Node.js: v22.13
Database: AWS Aurora MySQL 8.0 (provisioned cluster with autoscaling read replicas)
Description
We have a single “read” endpoint ...
- 169
3
votes
1
answer
98
views
Downscaling AWS RDS Aurora-MySQL instances
We use Terraform to manage AWS resources. I recently downscaled RDS Aurora-MySql8 cluster (one reader, one writer in different AZ) from r5 to t3 instances. I try to figure out from AWS event logs ...
- 1,843
0
votes
1
answer
78
views
MySQL Aurora (8.0.mysql_aurora.3.07.1) Cannot Alter or DROP Table "ERROR 1205 (HY000): Lock wait timeout exceeded; try restarting transaction"
MySQL Aurora (8.0.mysql_aurora.3.07.1)
Cannot run Alter table or DROP Table commands
Getting
"ERROR 1205 (HY000): Lock wait timeout exceeded; try restarting transaction"
What I already did ...
- 506
0
votes
1
answer
271
views
AWS RDS Aurora (postgres engine) upgrade from 13.12 to 14.17
I'm trying to upgrade my engine version from 13.12 to 14.17.
Below is my Terraform code:
resource "aws_rds_cluster" "aurora" {
cluster_identifier = local.env_config....
- 133
0
votes
0
answers
72
views
Unexpected restart of Aurora Mysql
We are experiencing repeated instability with our Aurora MySQL instance db.r7g.xlarge engine version 8.0.mysql_aurora.3.06.0, and despite the recent restart being marked as “zero downtime,” we ...
0
votes
0
answers
144
views
Entire data is not ingested by AWS Bedrock
I am trying to create a vector data using AWS Bedrock. I am passing a CSV file(stored in S3). While ingesting data, some of the data is randomly dropped by AWS. The csv file has 1000 rows while the ...
0
votes
0
answers
145
views
Liquibase errors out: ERROR: Exception Primary Reason: Argument data type char is invalid for argument 1 of substring function
I am facing an unusual error while deploying my database scripts. I am leveraging Liquibase to deploy my scripts. It was running all good till now, BTW, my DB server is Aurora Posgtres with Babelfish ...
- 391
1
vote
0
answers
49
views
Pentaho PDI 9.3 Can't connect after upgrade aws aurora mysql
After updating the database to a new version of Aurora MySQL on AWS, one of the steps no longer executes, and the log displays the following message:
Connection failed. Verify all connection ...
0
votes
0
answers
64
views
Aurora MySQL not using the most efficient index
So, we have a table on about 5M records and we are currently having some performance issues due to poor indexing. One of the issues is a report that uses the following query:
select o.name,
s....
- 1
0
votes
0
answers
43
views
AWS AppSync AWSDate Casting Issue with PostgreSQL
I am working with AWS AppSync and using the AWSDate scalar type in my GraphQL schema. According to the documentation, AWSDate supports ISO 8601 formats like:
YYYY-MM-DD (e.g., 2024-02-24)
Negative ...
0
votes
0
answers
16
views
How to connect to an AWS RDS MySQL Aurora database from Jupyter notebook using sql line magic [duplicate]
I want to be able to connect to an AWS RDS MySQL Aurora database using the "sql" magic, with the syntax:
%sql mysql://username:password@hostname/dbname
and just write SQL into cells ...
- 1,199
0
votes
1
answer
406
views
Can I use aws-advanced-jdbc-wrapper with MySQL?
My com has two environments.
dev: MySQL Community with no cluster
qa: Aurora MySQL cluster.
I'm planning to use aws-advanced-jdbc-wrapper with my new application.
Can I use the driver with both ...
- 22.4k
1
vote
1
answer
109
views
How can I update a large table slowly?
I am using PostgresSQL 15 hosted by AWS Aurora serverless v2. I have a table includes 200 millions rows and I need to update a value on a column for all those rows. This table has primary key id which ...
- 43.3k
2
votes
1
answer
316
views
Innodb not purging transactions
I got a warning in my AWS console about the InnoDB history list length increasing on one cluster. Taking a look at show engine innodb status, I see that the number in the "Purge done" line ...
- 121
0
votes
1
answer
371
views
create using AWS CDK Aurora-V2-Serverless (lowest-cost) [closed]
FYI. This is a HOW-TO.
As of Jan 2025, confirming that ServerlessCluster CDK-construct is NOT what you use for "Aurora-V2-Serverless" (in my case Postgres).
You must use DatabaseCluster CDK-...
- 470
0
votes
0
answers
84
views
RDS PostgreSQL - Change encryption type from aws_s3 extension
I have installed aws_s3 extension in Aurora PostgreSQL to write/read table data in S3 bucket.
I am able to create S3 objects by exporting DB query result set and able to read from it from the DB using ...
- 761
0
votes
1
answer
277
views
How can I connect to my aurora serverless v2 database instance?
I have deployed an aurora serverless v2 postgres database in aws, and have enabled an http endpoint and have enabled publicly_accessible = true in the instance settings in terraform. I have verified ...
- 906
1
vote
1
answer
166
views
Is there a way to create index slowly on a big table
I am using PostgresSQL 15 hosted by AWS Aurora serverless v2. I have a table includes 200 millions rows and I need to create an index on that table. The problem is that creating an index would take a ...
- 43.3k
0
votes
1
answer
152
views
Aurora - password authentication failed for user "postgres" - after password rotation
I'm using python lambda functions. In the beginning of the file I call this function:
def create_db_engines():
session = boto3.session.Session()
client = session.client(
service_name='...
- 1,396
0
votes
0
answers
32
views
How can I query the temp_file_limit value in Aurora/PostgreSQL? [duplicate]
I'm running reporting queries in Aurora/PostgreSQL and a few of them are running out of space with "no space left on device". I googled that the temp_file_limit parameter in PostgreSQL ...
- 49.3k
0
votes
1
answer
104
views
AWS RDS Aurora MySQL 5.7 upgrade to MySQL 8 failed with error: The 'InnoDB' feature is disabled; you need MySQL built with 'InnoDB' to have it working
We have an AWS RDS Aurora 2 (MySQL 5.7) cluster with one writer instance and one reader instance that we are trying to upgrade to Aurora 3 (MySQL 8). When trying to upgrade the upgrade fails and the ...
- 1
0
votes
1
answer
193
views
terraform aws aurora module: argument "engine" required, but it's actually there
I'm trying to instantiate an rds aurora cluster using the rds-aurora module:
https://registry.terraform.io/modules/terraform-aws-modules/rds-aurora/aws/latest
However, despite mostly following the ...
- 1,403
0
votes
1
answer
138
views
How to transfer data using Zero-ETL to a writable DB in Redshift
Im using Zero-Etl to move my data from Aurora to Redshift. But this moves the data to a read-only database. How do I then move my data to a full access database?
I have tried creating a materialized ...
2
votes
0
answers
26
views
AWS Aurora Serverless (Mysql 5.7) sometimes reuses recent deleted primary IDs
We have a table in our application in which users are allowed to delete a row from "staff_entries" table and the deleted row is also copied to another table (deleted_staff_entries) as it is (...
- 7,508
1
vote
3
answers
620
views
Trouble Upgrading MySQL 5.7 to 8: The auxiliary tables of FTS indexes on the table are created in system table-space due to bug
My team and I are attempting to upgrade our multi-tenancy AWS RDS/MySQL instance from MySQL 5.7 to 8. After trying the upgrade, we received a report showing a large number of errors for the customers, ...
- 958
0
votes
0
answers
93
views
Amazon Aurora MySQL slow to count not-null column
I'm trying to figure out how I can speed up the time to get a count of all the rows in an InnoDB table. My deployment environment is AWS Aurora MySQL, but I see the same behavior in regular MySQL.
I ...
- 6,935
0
votes
1
answer
217
views
pg_repack - CREATE INDEX stucj in IDLE state for than 24 hrs
I am in the process of pg_repacking a huge table (13TB). Following is the info for my setup:
pg_total_relation_size (Including indexes) - 13TB
pg_table_size - 4TB
pg_repack version - 1.4.7
Postgres ...
- 449
0
votes
1
answer
207
views
How can I remove old cluster after upgrading AWS RDS aurora from serverless v1 to serverless v2
I've upgraded AWS rds aurora postgress cluster from serverless v1 to serverless v2 using terraform.
The steps that I followed:
Creating snapshot of the serverless v1 cluster
Creating provisioned db ...
- 133
1
vote
1
answer
1k
views
Upgrading AWS RDS aurora from serverless v1 to serverless v2 using terraform
I'm upgrading AWS rds aurora postgress cluster from serverless v1 to serverless v2 using terraform.
The steps that I followed:
Creating snapshot of the serverless v1 cluster
Creating provisioned db ...
- 133
1
vote
0
answers
183
views
TypeORM stuck on RDS reader node after failover
I am having some strange issues with TypeORM when performing failover in RDS. I am currently using RDS Aurora MySQL, and when I perform a failover, I get the following message when attempting to ...
- 777
0
votes
1
answer
287
views
Using @prisma/extension-read-replica is there a way to redirect queries to writer instance if reader fails? this doesn't seems to default behaviour
I have an aws aurora postgres RDS having reader and writer instance, I connected it with my next.js application using prisma, and I setup the reader replica as mentioned in this doc, but this doc ...
0
votes
2
answers
82
views
Query is slow only if LIMIT is greater than rows returned
We are find a specific query running very very slow if the LIMIT value is larger than the number of returned rows. We are running MySQL on RDS - 8.0.mysql_aurora.3.02.0 and have no other performance ...
- 31
0
votes
2
answers
1k
views
aws rds version
Is it possible to get aws rds version?
I know for Aws rds Aurora version
select aurora_version();
aurora_version
----------------
16.3.0
(1 row)
select version();
...
- 703
1
vote
1
answer
138
views
What is the syntax for dropping an Amazon Aurora with mysql compatinility user with single quotes?
I'm using AWS 8.0.mysql_aurora.3.05.2
I do this to get a list of the users
SELECT user,host from mysql.user;
and have these entries, surrounded by single quotes ('...').
user |host ...
- 17.3k
0
votes
0
answers
70
views
Newly created user not showing in user DB?
I'm using AWS 8.0.mysql_aurora.3.05.2
I do this on an DB console (connected via DBeaver app).
use mysql;
CREATE USER 'my_user'@'%' IDENTIFIED by 'password123';
flush privileges;
and get feedback that ...
- 17.3k
3
votes
0
answers
692
views
Enable cross-region automated backup replication for Multi-AZ RDS Aurora Cluster [closed]
I have a question regarding implementing cross-region automated backups replication for RDS Aurora Postgres cluster in Terraform (ideally using 'internal' RDS service functionalities /API endpoints).
...
- 76
-1
votes
1
answer
89
views
Aurora 2.12.3 timing out on JDBC batch executions
Upgrading from Mysql 5.7 to Aurora 2.12.3 before jumping to Aurora MySQL 8 equivalent. Every previous process works except for any queries that utilize PreparedStatement .addBatch() and executeBatch()....
- 15
0
votes
0
answers
68
views
How to call PostgreSQL procedure inside loop?
I have a procedure like that;
CREATE OR REPLACE PROCEDURE insert_into_tableAv2(inout rows_affected INT) LANGUAGE 'plpgsql' AS $$ BEGIN
INSERT INTO insert_into_tableAv2 (serial, aaa, ooo, UPDATED)
...
- 203
-2
votes
1
answer
684
views
Migrating aws aurora rds db from serverless v1 to serverless v2 using terraform
I've been tasked with upgrading our AWS Aurora engine from Serverless version 1 to Serverless version 2 using Terraform. The steps described are basically to take a snapshot, create a new Provisioned ...
0
votes
1
answer
40
views
Does Enabling general_log in Aurora MySQL Show SSL Encryption Status of Connections?
I'm looking to determine if connections to my Aurora MySQL instance are SSL encrypted. Specifically, I want to know if enabling the general_log in the parameter group will provide information about ...
1
vote
0
answers
1k
views
Aurora PostgreSQL writer spikes suddenly with high io:xactsync
It's been 3 weeks since this happened and it keeps happening every 3-4 days. We are using AWS RDS Aurora PostgreSQL and we have 6 DMS tasks to replicate the data from the RDS to S3, we have another ...
