tm_map has parallel::mclapply error in R 3.0.1 on Mac

r parallel-processing tm mclapply
Dominik picture Dominik · Aug 17, 2013 · Viewed 15.3k times · Source

I am using R 3.0.1 on Platform: x86_64-apple-darwin10.8.0 (64-bit)

I am trying to use tm_map from the tm library. But when I execute the this code

library(tm)
data('crude')
tm_map(crude, stemDocument)

I get this error:

Warning message:
In parallel::mclapply(x, FUN, ...) :
  all scheduled cores encountered errors in user code

Does anyone know a solution for this?

Answer

nograpes picture nograpes · Aug 17, 2013

I suspect you don't have the SnowballC package installed, which seems to be required. tm_map is supposed to run stemDocument on all the documents using mclapply. Try just running the stemDocument function on one document, so you can extract the error:

stemDocument(crude[[1]])

For me, I got an error:

Error in loadNamespace(name) : there is no package called ‘SnowballC’

So I just went ahead and installed SnowballC and it worked. Clearly, SnowballC should be a dependency.

Related questions

run a for loop in parallel in R

I have a for loop that is something like this: for (i=1:150000) { tempMatrix = {} tempMatrix = functionThatDoesSomething() #calling a function finalMatrix = cbind(finalMatrix, tempMatrix) } Could you tell me how to make this parallel ? I tried this based on an example online, but …

Read More
Run multiple R-scripts simultaneously

In my thesis I need to perform a lot of simulation studies, which all takes quite a while. My computer has 4 cores, so I have been wondering if it is possible to run for example two R-scripts in Rstudio at …

Read More
"un-register" a doParallel cluster

If I run foreach... %dopar% without registering a cluster, foreach raises a warning, and executes the code sequentially: library("doParallel") foreach(i=1:3) %dopar% sqrt(i) Yields: Warning message: executing %dopar% sequentially: no parallel backend registered However, if I run this …

Read More