How to handle throttling with JavaScript AWS IAM SDK 3?

Question

I am using @aws-sdk/client-iam SDK from AWS for JavaScript, In a node based server. We are using GetGroupCommand.

If we aggressivley call above command AWS SDK throws Throttling error, with a field error?.$metadata?.totalRetryDelay which tells after how many milliseconds we shall retry the request.

Based on this trial - error thing we have modified the calls to sleep for certain amount of time, But when calls are too many they all retry after sleep causing the AWS server to flood again & throw the Throttling error.

I couldn't find any guide/reference for AWS JS IAM SDK 3 explaining under what conditions it may throw Throttling error.

There is middleware https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/modules/_aws_sdk_middleware_retry.html I guess it's something we can use, but not sure how. Sample example of this or best practices for throttling for AWS SDK JS 3 are not mentioned on the github repo or the sdk guide.

Can you show me how to handle this Throttling issue in AWS SDK 3 for JS?

None of the following have any helpful information about throttling,

SDK Reference: https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/index.html

Developer guide: https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/welcome.html

Code examples: https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/sdk-code-samples.html

I edited your good question to remove the request for references; the question might otherwise be closed because it looks like a request for some off-site resource. — O. Jones
– O. Jones, Commented Apr 6, 2021 at 13:22

O. Jones · Accepted Answer · 2021-04-06 13:30:55Z

2

That totalRetryDelay value would be most useful to you if your nodejs program were not sending multiple concurrent requests to the API. It tells you how long to wait before you send one more request, not 10 or 50 more.

The solution to your problem might be to put your requests into some sort of internal queue and send them one at a time with a short delay between them.

Or, if you know how many concurrent requests you send, you could try multiplying totalRetryDelay by that number and delay that much.

answered Apr 6, 2021 at 13:30

O. Jones

110k17 gold badges135 silver badges188 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to handle throttling with JavaScript AWS IAM SDK 3?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related