1,878 questions
-1
votes
0
answers
55
views
Does AWS ElastiCache Redis Serverless support Celery as a Redis broker? Workers connect but never consume tasks [closed]
I’m attempting to use Amazon ElastiCache Serverless for Redis (Redis 7.1, cluster‑mode enabled) as the message broker for Celery 5.3+ running on Amazon ECS Fargate. Celery powers asynchronous ...
0
votes
1
answer
59
views
NextJS standalone under ECS Container, can not use localhost or 127.0.0.1
I have a frontend app running at port 3000.
.........
USER nextjs
EXPOSE 3000
ENV PORT=3000
ENV HOSTNAME="0.0.0.0"
CMD ["node", "server.js"]
Inside the frontend's ...
1
vote
1
answer
56
views
Sync-ops in stackexchange redis timeouts
StackExchange.Redis.RedisTimeoutException: Timeout awaiting response (outbound=0KiB, inbound=4KiB, 6000ms elapsed, timeout is 3000ms), command=EXISTS, next: GET mykey, inst: 0, qu: 0, qs: 0, aw: True, ...
0
votes
1
answer
101
views
EKS: AWS Fargate: ImagePullBackOff due to "no match for platform in manifest" when deploying
Environment Setup:
Created an EKS cluster.
Added a Fargate profile and configured fargate-apps as the
namespace.
Built a Node.js Docker Image on my Local.
Pushed the image to private Amazon ECR with ...
-1
votes
1
answer
42
views
ECS RunTask Error: States/ECS RunTask/Arguments: The field 'TaskDefinition' is required but was missing
I defined my ECS RunTask like this, but i keep getting this error when saving: States/ECS RunTask/Arguments: The field 'TaskDefinition' is required but was missing even when my Task definition isnt ...
0
votes
1
answer
138
views
Artillery + PlayWright + Fargate: Test durations ramping up and timing out
I'm running a load test on a web application using Artillery with the Playwright engine on AWS Fargate. I'm observing a steady increase in test durations as the test progresses, and a high percentage ...
0
votes
1
answer
69
views
Docker Base Image for EKS Workload [closed]
I'm creating Docker images for an EKS workload running on Fargate. Initially, I selected the Amazon Corretto official image. However, it seems there is no JRE-only version of the Corretto image ...
0
votes
1
answer
58
views
Fargate Cloudwatch CPU Utilisation differs from docker stats
Looking at the CPUUtilized Cloudwatch metric for my Fargate service, it's showing max cpu units used as 1040 over the past 4 weeks, using a sampling period of 1 minute. I have 4 vCPUs provisioned to ...
0
votes
0
answers
78
views
Custom DogStatsD metrics not making it to the dashboard with agent
I have an ECS Fargate task definition that contains a high throughput Rust poem server container which sends custom statsd metrics (using the cadence crate) over a shared Unix socket to a second ...
1
vote
1
answer
69
views
ECS Fargate Task performance worsened after re-deploying same task definition
We have an ecs service that uses Fargate tasks to connect to dynamoDB.
The application has an optimized fetch time under 100ms when querying dynamoDB tables in our testing environment.
For some R&...
0
votes
0
answers
64
views
AWS ECS Fargate Tasks In Private Subnet Unreachable from ALB
Problem
I’m trying to deploy a React UI (built with Vite, served via Nginx) in Amazon ECS Fargate in a private subnet that can be reached through an internet-facing Application Load Balancer (ALB) in ...
1
vote
2
answers
144
views
ECS Service Connect causing intermittent ~10s timeouts, while direct IP calls are stable
I'm trying to diagnose a persistent and frustrating issue with AWS ECS Service Connect where my inter-service calls are intermittently timing out. I've managed to rule out several potential causes but ...
0
votes
0
answers
189
views
GCP Workload Identity Federation from AWS Fargate Fails with iam.serviceAccounts.getAccessToken PERMISSION_DENIED
I am trying to authenticate a Python script running in an AWS Fargate container to Google Cloud APIs using Workload Identity Federation. Despite what appears to be a correct configuration on both the ...
0
votes
1
answer
103
views
Issue ECS deployment
I am working to get more familiar working with ECS and using github actions for the deployment, but in this moment I am facing an issue at the moment to deploy, so basically I am building a pipeline ...
0
votes
1
answer
79
views
Is it possible to fine-tune an LLM using LoRA on AWS ECS Fargate?
I’m trying to fine-tune a lightweight LLM (like TinyLlama) using LoRA for a small custom dataset, but I'm facing two major issues:
Problem 1:
When I fine-tune the model locally, I’m unable to push the ...
0
votes
0
answers
34
views
In Lightsail Containers, is it possible to modify the gateway timeout?
I am getting a 504 Gateway Timeout when a process exceeds 60s in Lightsail Containers. I assume 60s is the default timeout, is there a way to modify this?
1
vote
3
answers
148
views
EKS Fargate: How to disable container logs to CloudWatch?
We are running our app on EKS Fargate. As per the AWS documentation we can disable the Fluenbit process logs to Cloudwatch by setting flb_log_cw: "false" in the ConfigMap.
But do you know ...
1
vote
1
answer
334
views
Memory leak on ECS fargate sidecar container
I have a Python application running on AWS ECS Fargate with a simple sidecar container. The sidecar is responsible for:
Receiving gRPC requests from the main application(on localhost:port)
Querying a ...
0
votes
0
answers
71
views
Deploy AWS Fargate Service despite task protection
I am running an AWS Fargate Service with a Task that hasa desired count of 1. While the container is running it is polling an SQS queue for messages to process. I have set up Autoscaling depending on ...
1
vote
1
answer
155
views
Spark executor memory limit higher than expected
I'm running Spark on EKS with Fargate. I don't quite understand why the memory of the Spark executor is always different from my expectations. When I set:
spark.executor.memory = 6g
spark.executor....
0
votes
1
answer
81
views
Setting up CloudMap on Fargate services using a PublicDnsNamespace
So, I am trying to set up a set of fargate services that need to communicate with each other. One is available on the interwebs via a load balancer.
I am currently using a PublicDnsNamespace and ...
0
votes
0
answers
54
views
AWS WebSocket API (WSS) Handshake Succeeds, No Data Received
I have a Node.js server hosted on AWS Fargate, listening on port 8080. It's responsive and working as expected.
The server is connected to a WebSocket API, and I’ve tested both tcp:8080 and http:8080 ...
0
votes
0
answers
153
views
How to run FlyWay on ECS?
I want to run FlyWay commands that performs a database migration on an RDS instance located in a private subnet. Infrastructure needs to be set up using CDK. The Fargate service will be called from ...
1
vote
1
answer
211
views
ECS Fargate Scale in issue
I am testing ecs fargate auto scaling. I have set the threshold to 60% for scale out. I increased the load above 60% and scale out is working fine. But during scale in it is not reducing the task even ...
0
votes
0
answers
102
views
How can I see network traffic between API Gateway and my (ECS) Service?
I am trying to view the requests and responses between API Gateway and my Service. I can see logs in cloudwatch, but they are not very informative:
{
"requestTime": "\"11/Mar/...
0
votes
0
answers
142
views
Datadog agent with ECS Fargate does not run with cws-instrumentation-volume
I'm following the Datadog setup for ECS with Fargate and using the task definition provided (https://docs.datadoghq.com/resources/json/datadog-agent-cws-ecs-fargate.json), but while I'm able to see ...
-1
votes
1
answer
274
views
How to connect to a Fargate container with ECS Exec? [closed]
When I try to connect to the FARGATE container I have got this message error below
I tried many things, to add vpc endpoint but still the same error.
I also tried to "enable_execute_command = ...
0
votes
0
answers
142
views
How to launch ECS task instances dynamically using C#?
I have a micro-services application that I am deploying to AWS using ECS Fargate. Most of the containers can be deployed as long running tasks in a service. However, I need to spin up new containers ...
0
votes
0
answers
231
views
Signature expired exception when AWS lambda runs more than 5 minutes from C#
I have a C# application on .NET 6 running at AWS ECS Fargate. It calls AWS lambda function using AWS SDK. The C# code works well when the lambda runs less than 5 minutes, but gets the following ...
0
votes
0
answers
128
views
Specific instructions for AWS fargate metrics using opentelemetry-collector sidecar
Does anybody know of an example or an article giving instructions on how to collect memory, cpu, perhaps k8s behaviour etc stats/metrics on AWS fargate pods running the otel collector as a sidecar and,...
0
votes
0
answers
71
views
AWS Elasticache - PHP Memcached - Multiple Tab Log-out
Configuration
Our system has:
PHP 8.2
AWS Memcached library with OpenSSL
AWS Fargate ECS deployment
AWS Elasticache
Problem
The initial login for users appears to write and read from memcached. ...
0
votes
1
answer
44
views
Cost of Fargate service running zero pods on a specific day
Say I have a fargate service configured with minimum of zero pods and maximum of 5.
And say on one particular day the service was never invoked and there were zero pods running the entire day. Will ...
0
votes
1
answer
56
views
Vue is not picking up env variables from aws ecs task container
I have a Vue 2.6 app which is deployed in aws ecs task container 1.4 , but in the console it is not pciking up the env variables which I have set up in the aws task environment variable. For example I ...
0
votes
0
answers
74
views
Kafka: Failed to allocate memory within the configured max blocking time 60000 ms
KAFKA: Error while sending message for exception: org.apache.kafka.common.errors.TimeoutException: Failed to allocate memory within the configured max blocking time 60000 ms
Configuration I am using:
...
0
votes
0
answers
90
views
How to Configure Horizontal Pod Autoscaler (HPA) on EKS Fargate with Metrics Server - Getting 403 Forbidden Error
I am trying to configure the Horizontal Pod Autoscaler (HPA) on my EKS Fargate setup, but I am running into an issue where the Metrics Server is returning a 403 Forbidden error when it tries to scrape ...
0
votes
1
answer
75
views
AWS SAM-defined ECS Fargate scheduled task won't start
I used the following script (anonymised) to create a scheduled Fargate task (and the other needed components):
Transform: AWS::Serverless-2016-10-31
AWSTemplateFormatVersion: "2010-09-09"
...
0
votes
0
answers
96
views
How to Enable Docker Access for Jenkins Agents Running on AWS ECS Fargate?
I've been stuck on this issue for a while now. I have successfully deployed a Jenkins controller and agent setup using Terraform and the AWS ECS Fargate plugin for Jenkins. Everything works fine, and ...
1
vote
0
answers
72
views
ECS Fargate Task Error with Signature Expired Earlier Than 5 mins
I am running a Fargate task on ECS which is time consuming but I only start seeing this error recently.
My CMD start up a Python script and has following steps:
Enter Python from CMD ["python3&...
1
vote
0
answers
298
views
Java application running in ECS Fargate Service cannot load credentials
I have an ECS service which is running on Fargate (latest version). The service runs a Java (Spring) application which makes use of the AWS SDK (version 2.29.29). However, the following error is ...
0
votes
0
answers
50
views
Pods are getting recreated due to the fargate node in EKS
I am running my workload in EKS Cluster using Fargate node and it runs successfully but intermittently I see my fargate nodes are recreated from AWS so the Kubernetes statefulset and deployment ...
0
votes
2
answers
227
views
Terraform Deployment of ECS Targets Failing
So, I've used terraform and modules to deploy AWS resources step-by-step. After creating VPCs, RDS databases, etc., I uploaded my docker image to ECR and then try to use it when launching ECS with ...
1
vote
1
answer
182
views
Struggling to deploy FastAPI + PostgreSQL with docker compose on ECS (Essential container exiting without logs)
I’m facing a persistent issue while trying to deploy my FastAPI + PostgreSQL app using docker compose on AWS ECS Fargate. Despite multiple debugging attempts, I can’t seem to get it working properly. ...
1
vote
1
answer
429
views
How can I assign different IAM roles to two containers in the same ECS Task?
I have an ECS task which involves two containers running in a sidecar pattern. Per Amazon documentation, this is recommended for my use case where the containers share a lifecycle and need to run on ...
1
vote
1
answer
1k
views
AWS Fargate task completes with "Essential container in task exited"
A fargate task I have written in python 3.12 will run and complete but always complains about:
"Essential container in task exited"
"Stopped | Exit code: 0"
My guess is that I need ...
1
vote
1
answer
477
views
How can I get list of files from directory in ECS Fargate container
Ive tried everything I have seen online on how to make this happen. Basically I need to get a list of files from a specific directory on the container, everything Ive seen tells me I can do this with ...
0
votes
1
answer
49
views
How to handle number of queries that need to be run hourly
I have a usecase where my workers have run about ~100 queries at an hourly cadence. I don't want to have 100 individual lambdas run each of them separately as the count of queues may increase in the ...
0
votes
1
answer
500
views
Aspnet:8.0 Docker Image does not listen on port 8081 when deployed to Amazon ECS
We have a simple web project built using .Net 8.0 and using Docker. We have made no changes to the default Dockerfile that Visual Studio created
FROM mcr.microsoft.com/dotnet/aspnet:8.0 AS base
USER ...
2
votes
1
answer
260
views
ECS nightly scale in of fargate services
To save on fargate costs I wanted to scale down our dev environment consisting of around 100 ECS services overnight and on weekends. I've setup auto scaling via Terraform to achieve this as so:
...
0
votes
0
answers
111
views
AWS Fargate ResourceInitializationError
I get the error "ResourceInitializationError: unable to pull secrets or registry auth: The task cannot pull registry auth from Amazon ECR: There is a connection issue between the task and Amazon ...
1
vote
1
answer
321
views
Fargate task-level SNS topic subscriptions
In current state, I have a AWS Batch, which is configured to run ML training jobs. At the end of its flow, model artifacts are stored in an S3 bucket. Additionally, I have an AWS Application Load ...