How to implement distributed rate limiter?

guava distributed-computing apache-zookeeper rate-limiting apache-curator
Dhrumil Upadhyaya picture Dhrumil Upadhyaya · Jul 19, 2015 · Viewed 9.7k times · Source

Let's say, I have P processes running some business logic on N physical machines. These processes call some web service S, say. I want to ensure that not more than X calls are made to the service S per second by all the P processes combined.

How can such a solution be implemented?

Google Guava's Rate Limiter works well for processes running on single box, but not in distributed setup.

Are there any standard, ready to use, solutions available for JAVA? [may be based on zookeeper]

Thanks!

Answer

Bukhtoyarov Vladimir picture Bukhtoyarov Vladimir · Apr 28, 2017

Bucket4j is java implementation of "token-bucket" rate limiting algorithm. It works both locally and distributed(on top of JCache). For distributed use case you are free to choose any JCache implementation like Hazelcast or Apache Ignite. See this example of using Bucket4j in cluster.

Related questions

Map implementation with duplicate keys

I want to have a map with duplicate keys. I know there are many map implementations (Eclipse shows me about 50), so I bet there must be one that allows this. I know it's easy to write your own map that …

Read More
UnmodifiableMap (Java Collections) vs ImmutableMap (Google)

Context I need to return a reference to a map that I'm using for a data cache, and I'd like to make sure nobody can modify their reference. Question I've seen lots of references to UnmodifiableMap and ImmutableMap online, but …

Read More
initializing a Guava ImmutableMap

Guava offers a nice shortcut for initializing a map. However I get the following compiler error (Eclipse Indigo) when my map initializes to nine entries. The method of(K, V, K, V, K, V, K, V, K, V) in the …

Read More