Top "Multiprocessing" questions

Multiprocessing is the use of two or more central processing units (CPUs) within a single computer system.

how to use initializer to set up my multiprocess pool?

I'm trying to use the multiprocess Pool object. I'd like each process to open a database connection when it starts, …

python multiprocessing
Using the multiprocessing module for cluster computing

I'm interested in running a Python program using a computer cluster. I have in the past been using Python MPI …

python parallel-processing multiprocessing
Python multiprocessing with pathos

I am trying to use Python's pathos to designate computations into separate processes in order to accelerate it with multicore …

python multiprocessing pool pathos
How to best perform Multiprocessing within requests with the python Tornado server?

I am using the I/O non-blocking python server Tornado. I have a class of GET requests which may take …

python multiprocessing tornado python-multithreading
Python multiprocessing pool hangs at join?

I'm trying to run some python code on several files in parallel. The construct is basically: def process_file(filename, …

python multiprocessing
High Memory Usage Using Python Multiprocessing

I have seen a couple of posts on memory usage using Python Multiprocessing module. However the questions don't seem to …

python performance memory multiprocessing
Share Large, Read-Only Numpy Array Between Multiprocessing Processes

I have a 60GB SciPy Array (Matrix) I must share between 5+ multiprocessing Process objects. I've seen numpy-sharedmem and read this …

python numpy multiprocessing shared-memory
multiprocessing in python - sharing large object (e.g. pandas dataframe) between multiple processes

I am using Python multiprocessing, more precisely from multiprocessing import Pool p = Pool(15) args = [(df, config1), (df, config2), ...] #list of …

python pandas multiprocessing
Why does my Python program average only 33% CPU per process? How can I make Python use all available CPU?

I use Python 2.5.4. My computer: CPU AMD Phenom X3 720BE, Mainboard 780G, 4GB RAM, Windows 7 32 bit. I use Python threading …

python performance process multiprocessing cpu-usage
What is the difference between multiprocessing and subprocess?

My work should use parallel techniques, and I a new user of python. So I wonder if you could share …

python subprocess multiprocessing