AWS Lambda TooManyRequestsException: Rate Exceeded

node.js amazon-web-services aws-lambda rate-limiting
nelsonic picture nelsonic · Apr 24, 2016 · Viewed 23.1k times · Source

When attempting to execute an Amazon Web Services (AWS) Lambda function (many times) we were seeing the error:

AWS Lambda TooManyRequestsException: Rate Exceeded

How do we resolve this?

Answer

nelsonic picture nelsonic · Apr 26, 2016

As noted by Michael, this is the error message you will see when you reach the documented default "safety" limit of 100 concurrent invocations:

"AWS Lambda has a default safety throttle of 100 concurrent executions per account per region. If you wish to submit a request to increase the throttle of 100 concurrent executions you can visit our Support Center..."

The solution was to open a support ticket providing the following info:

Limit increase request 1 
Service: Lambda 
Region: EU (Ireland) 
Limit name: concurrent requests (average duration * average TPS) 
New limit value: 2000

And then in the body of the ticket/request try to estimate your usage pattern:

Expected average requests per second: 200 
Expected peak requests per second: 2000 
Expected function duration: 2 seconds 
Function memory size: 1000mb 
Invocation Type: Request-response 
Event Source: Api Gateway & Lambda<->Lambda

It can take a while to get a response from AWS Support unless you are paying for premium support, so its best to load test your app during development/staging and request to increase concurrent invocations before you launch your app!

In our case it took 45 hours from initial support request to get the invocation limit increase. aws-lambda-limits-increase-request aws-lambda-limits-request-sorted

The AWS support people are lovely, it just took what felt like ages (almost two days!) to get the service level increase, which would have been fatal if our launch had been public!

Related questions

Can an AWS Lambda function call another

I have 2 Lambda functions - one that produces a quote and one that turns a quote into an order. I'd like the Order lambda function to call the Quote function to regenerate the quote, rather than just receive it from …

Read More
Why is this HTTP request not working on AWS Lambda?

I'm getting started with AWS Lambda and I'm trying to request an external service from my handler function. According to this answer, HTTP requests should work just fine, and I haven't found any documentation that says otherwise. (In fact, people …

Read More
Nodejs - Invoke an AWS.Lambda function from within another lambda function

I have the following function which I use to invoke a Lambda function from within my code. However when I try to use it within a Lambda function, I get the following error: AWS lambda undefined 0.27s 3 retries] invoke({ FunctionName: …

Read More