Nginx Server Load test fails ( Node.js application )

Question

I'm encountering an issue while load testing my Node.js Sequelize PostgreSQL application running on an NGINX server using JMeter. When I set 1000 threads with a 1-second ramp-up time, everything runs smoothly. However, when I increase the load to 10,000 threads with a 10-second ramp-up time, some calls fail with errors such as "connection refused," "connection timed out," or "failed to connect to server."

To troubleshoot, I performed the same load test directly on the NGINX API without involving Node.js. Surprisingly, I still encountered similar issues, even though NGINX returned a 200 status code.

I suspect there might be a misconfiguration in my NGINX setup. Any insights on how to diagnose and resolve this issue would be greatly appreciated.

what's the value of worker_connections in your nginx config? nginx.com/blog/avoiding-top-10-nginx-configuration-mistakes — user2959798
– user2959798, Commented May 15, 2024 at 8:48
Would be great to see nginx.conf file, also need to tune network stack in server. You can contact me in LinkedIn (see my profile) I'll help You via skype or zoom. — num8er
– num8er, Commented May 15, 2024 at 10:34
also do tail -f /var/log/nginx/error.log and tail -f /var/log/nginx/access.log to see what's nginx alerting when ddosing it. I suspect port limits, open file limits, workers count, read timeout (which should be small to make "slow" clients to be kicked out). — num8er
– num8er, Commented May 15, 2024 at 10:47

Muhammad Asif Javed · Accepted Answer · 2024-05-15 15:53:36Z

1

+50

it seems that when you send 10,000 threads then it reach the connection limit. try to increase number of connections.

    events {
           worker_connections 10240; # Adjust this number as needed for this may be 10, 000 +
     }

along this check the keep_alive option, i.e how many request can be entertained

keepalive_requests  10000; # Adjust this number as needed for this may be 10, 000 +

if you go outside the nginx may be you can try to update the system limits:

    * soft nofile 100000
    * hard nofile 100000

Please try the solutions, this mainly seems to be the request limit issue.

answered May 15, 2024 at 15:53

Muhammad Asif Javed

6182 gold badges8 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Nginx Server Load test fails ( Node.js application )

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related