R - Error when using getURL from curl after site was changed

r rcurl
mikecro picture mikecro · May 8, 2017 · Viewed 8.1k times · Source

I have been using getURL from curl (in R) to read from https://fantasy.premierleague.com/drf/bootstrap-static

Example code: print(getURL("https://fantasy.premierleague.com/drf/bootstrap-static"))

No problem until a few days ago. But now getting the error: 

Error in function (type, msg, asError = TRUE)  : 
  error:1407742E:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert protocol version

Have upgraded to latest R (3.4.0) and curl package: RCurl_1.95-4.8

I have a workaround (to use GET from httr) but can anyone help me get it working with getURL?

I believe the server change is that they only now support TLS 1.2. I have tried the following to fix but now get a new error. May relate to needing newer OpenSSL?

CURL_SSLVERSION_TLSv1_2 <- 6L
opt <- RCurl::curlOptions(verbose = TRUE, sslversion = 
CURL_SSLVERSION_TLSv1_2)
print( RCurl::getURL("https://fantasy.premierleague.com/drf/bootstrap-static", .opts = opt))

New error is:

Unsupported SSL protocol version

Answer

user1966593 picture user1966593 · Aug 2, 2017

I think if you remove the getURL part of the code it should work ok

url = "https://fantasy.premierleague.com/drf/bootstrap-static"
json = fromJSON((url))

Related questions

"Non Zero Exit Status" R 3.0.1 'XML' and 'RCurl'

I am having a bit of trouble installing XML and RCurl on my Ubuntu machine 13.10. I performed all sudo update and upgrades today. I am trying to use rattle for R. I am unable to install 'XML' which is required …

Read More
POST request using RCurl

As a way of exploring how to make a package in R for the Denver RUG, I decided that it would be a fun little project to write an R wrapper around the datasciencetoolkit API. The basic R tools come …

Read More
Scrape password-protected website in R

I'm trying to scrape data from a password-protected website in R. Reading around, it seems that the httr and RCurl packages are the best options for scraping with password authentication (I've also looked into the XML package). The website I'm …

Read More