Throttling method calls to M requests in N seconds

java throttling
vtrubnikov picture vtrubnikov · Sep 10, 2009 · Viewed 91.3k times · Source

I need a component/class that throttles execution of some method to maximum M calls in N seconds (or ms or nanos, does not matter).

In other words I need to make sure that my method is executed no more than M times in a sliding window of N seconds.

If you don't know existing class feel free to post your solutions/ideas how you would implement this.

Answer

Michael Borgwardt picture Michael Borgwardt · Sep 10, 2009

I'd use a ring buffer of timestamps with a fixed size of M. Each time the method is called, you check the oldest entry, and if it's less than N seconds in the past, you execute and add another entry, otherwise you sleep for the time difference.

Related questions

Throttling CPU/Memory usage of a Thread in Java?

I'm writing an application that will have multiple threads running, and want to throttle the CPU/memory usage of those threads. There is a similar question for C++, but I want to try and avoid using C++ and JNI if …

Read More
Creating a unique timestamp in Java

I need to create a timestamp (in milliseconds) in Java that is guaranteed to be unique in that particular VM-instance. I.e. need some way to throttle the throughput of System.currentTimeMillis() so that it returns at most one results …

Read More
Throttling method calls using Guava RateLimiter class

I am trying to throttle the number of calls to a method per second. I tried to achieve this using Guava RateLimiter. RateLimiter rateLimiter = RateLimiter.create(1.0);//Max 1 call per sec rateLimiter.acquire(); performOperation();//The method whose calls are to be …

Read More