How to solve 'protection stack overflow' issue in R Studio

r stack-overflow glmnet
Ansjovis86 picture Ansjovis86 · Sep 28, 2015 · Viewed 17.2k times · Source

I'm trying to build a model with the glmnet package, but I'm getting the following error when I run the following line:

#library('glmnet')
x = model.matrix(response ~ ., data = acgh_frame[,c(3:ncol(acgh_frame))])

Error: protect(): protection stack overflow

I know this is due to my large number of variables (26k+) in the dataframe. When I use fewer variables the error doesn't show. I know how to solve this in command line R, but I require to stay in R studio, so I want to fix it from R Studio. So, how do I do this?

Answer

Technophobe01 picture Technophobe01 · Sep 28, 2017

@Ansjovis86

You can specify the ppsize as a command line argument to Rstudio 

rstudio.exe --max-ppsize=5000000

You may also with to set the expression option via your .Rprofile or at runtime by using the options(expressions = 5e5) command.

> options(expressions = 5e5)
>?options

...

expressions:

sets a limit on the number of nested expressions that will be evaluated. Valid values are 25...500000 with default 5000. If you increase it, you may also want to start R with a larger protection stack; see --max-ppsize in Memory. Note too that you may cause a segfault from overflow of the C stack, and on OSes where it is possible you may want to increase that. Once the limit is reached an error is thrown. The current number under evaluation can be found by calling Cstack_info.

Cstack_info() - to determine current setting.s

Related questions

Explanation of R: options(expressions=) to non-computer scientists

I have written a recursive function of the form foo=function(vars,i=2){ **do something with vars** if(i==length(vars)){ return(**something**) }else{ foo(vars,i+1) } } length(vars) is around 1500. When I execute it, I got the error Error: …

Read More
Remove rows with all or some NAs (missing values) in data.frame

I'd like to remove the lines in this data frame that: a) contain NAs across all columns. Below is my example data frame. gene hsap mmul mmus rnor cfam 1 ENSG00000208234 0 NA NA NA NA 2 ENSG00000199674 0 2 2 2 2 3 ENSG00000221622 0 NA NA NA NA 4 …

Read More
Drop data frame columns by name

I have a number of columns that I would like to remove from a data frame. I know that we can delete them individually using something like: df$x <- NULL But I was hoping to do this with …

Read More