General-purpose distributed scheduling library for Java

jdevelop picture jdevelop · May 16, 2012 · Viewed 10.8k times · Source

I'm looking for some general library for scheduling lots of tasks. The library has to provide ability to split tasks across nodes in cluster, perform load balancing and fault tolerance - so if some node goes down, the tasks for the node has to be distributed across remaining nodes.

I looked at the Hadoop - but look like it will work well for map-reduce tasks. In my case tasks are simply senders of notifications, checkers for object state etc.

Quartz seems to be great - but it's not clear how good is it when it comes down to dispatching events to nodes.

Any other options?

Answer

Christian Schlichtherle picture Christian Schlichtherle · May 16, 2012

Sounds like a use case for Akka.