Top "Executors" questions

How to get thread id from a thread pool?

I have a fixed thread pool that I submit tasks to (limited to 5 threads). How can I find out which …

java multithreading threadpool executorservice executors

How to avoid Spark executor from getting lost and yarn container killing it due to memory limit?

I have the following code which fires hiveContext.sql() most of the time. My task is I want to create …

memory apache-spark apache-spark-sql yarn executors

Java Executor with throttling/throughput control

I'm looking for a Java Executor that allows me to specify throttling/throughput/pacing limitations, for example, no more than …

java multithreading executors

ScheduledExecutorService, how to stop action without stopping executor?

I have this code: ScheduledExecutorService scheduledExecutor; ..... ScheduledFuture<?> result = scheduledExecutor.scheduleWithFixedDelay( new SomethingDoer(),0, measurmentPeriodMillis, TimeUnit.MILLISECONDS); After some event …

java executors

Abort countDownLatch.await() after time out

I am using an ExecutorService to implement a 3-thread pool, and CountDownLatch to monitor the completion of all threads, for …

java multithreading executorservice executors

Spark - How many Executors and Cores are allocated to my spark job

Spark architecture is entirely revolves around the concept of executors and cores. I would like to see practically how many …

python scala hadoop apache-spark executors

spark executor out of memory in join and reduceByKey

In spark2.0, I have two dataframes and I need to first join them and do a reduceByKey to aggregate the …

apache-spark out-of-memory executor executors

Detailed difference between Java8 ForkJoinPool and Executors.newWorkStealingPool?

What is the low-level difference among using: ForkJoinPool = new ForkJoinPool(X); and ExecutorService ex = Executors.neWorkStealingPool(X); Where X is …

multithreading executorservice fork-join executors forkjoinpool