Top "Python-multiprocessing" questions

multiprocessing is a package that supports spawning processes using an API similar to the threading module in python programming language.

Where is documentation for multiprocessing.pool.ApplyResult?

There is frighteningly little strict API documentation (read: ZERO) for multiprocessing.pool.ApplyResult. The multiprocessing explanation doc talks about ApplyResults, …

python python-2.x python-2.6 python-multiprocessing
ThreadPoolExecutor, ProcessPoolExecutor and global variables

I am new to parallelization in general and concurrent.futures in particular. I want to benchmark my script and compare …

python python-3.x python-multiprocessing python-multithreading concurrent.futures
Can I use map / imap / imap_unordered with functions with no arguments?

Sometimes I need to use multiprocessing with functions with no arguments. I wish I could do something like: from multiprocessing …

python python-multiprocessing
Get return value for multi-processing functions in python

I have two functions to run in parallel and each of them returns a value. I need to wait for …

python python-multithreading python-multiprocessing
From concurrent.futures to asyncio

I have two problems with concurrent.futures: How to break time.sleep() in a python concurrent.futures? Conclusion: time.sleep() …

python python-multiprocessing python-asyncio concurrent.futures
Python3 can't pickle _thread.RLock objects on list with multiprocessing

I'm trying to parse the websites that contain car's properties(154 kinds of properties). I have a huge list(name is …

python python-multiprocessing
How to run independent transformations in parallel using PySpark?

I am trying to run 2 functions doing completely independent transformations on a single RDD in parallel using PySpark. What are …

python-2.7 apache-spark pyspark apache-spark-sql python-multiprocessing
Process.join() and queue don't work with large numbers

I am trying to split for loop i.e. N = 1000000 for i in xrange(N): #do something using multiprocessing.Process …

python python-2.7 python-multiprocessing
multi-processing with spark(PySpark)

The usecase is the following: I have a large dataframe, with a 'user_id' column in it (every user_id …

python apache-spark pyspark spark-dataframe python-multiprocessing
_multiprocessing.SemLock is not implemented when running on AWS Lambda

I have a short code that uses the multiprocessing package and works fine on my local machine. When I uploaded …

python-multiprocessing aws-lambda