Top "Dask" questions

Dask is a parallel computing and data analytics library for Python.

Dask: How would I parallelize my code with dask delayed?

This is my first venture into parallel processing and I have been looking into Dask but I am having trouble …

multithreading python-3.x parallel-processing python-multiprocessing dask
Convert string to dict, then access key:values??? How to access data in a <class 'dict'> for Python?

I am having issues accessing data inside a dictionary. Sys: Macbook 2012 Python: Python 3.5.1 :: Continuum Analytics, Inc. I am working with …

python pandas dictionary data-manipulation dask
Airflow + celery or dask. For what, when?

I read in the official Airflow documentation the following: What does this mean exactly? What do the authors mean by …

celery dask airflow
dask dataframe apply meta

I'm wanting to do a frequency count on a single column of a dask dataframe. The code works, but I …

python pandas dask
Assign (add) a new column to a dask dataframe based on values of 2 existing columns - involves a conditional statement

I would like to add a new column to an existing dask dataframe based on the values of the 2 existing …

python pandas dask
Sampling n= 2000 from a Dask Dataframe of len 18000 generates error Cannot take a larger sample than population when 'replace=False'

I have a dask dataframe created from a csv file and len(daskdf) returns 18000 but when I ddSample = daskdf.sample(2000) …

python dask
duplicate key value violates unique constraint - postgres error when trying to create sql table from dask dataframe

Following on from this question, when I try to create a postgresql table from a dask.dataframe with more than …

python postgresql pandas dask pandas-to-sql
How to specify metadata for dask.dataframe

The docs provide good examples, how metadata can be provided. However I still feel unsure, when it comes to picking …

python pandas dask
Nested data in Parquet with Python

I have a file that has one JSON per line. Here is a sample: { "product": { "id": "abcdef", "price": 19.99, "specs": { "voltage": "110…

python json parquet dask
How to see progress of Dask Compute task?

I would like to see a progressbar on Jupyternotebook while i'm running a compute task using Dask, I'm counting all …

python-3.x jupyter-notebook distributed-computing dask