IOUtils.copy and IOUtils.copyLarge are very slow

java http inputstream apache-commons-io
Brett Slocum picture Brett Slocum · Jul 13, 2012 · Viewed 10.4k times · Source

I've implemented a REST service for downloading a moderately large (250 Mb) zip file using IOUtils.copy(), similar to Most effective way to write file to servletoutputstream. The REST service is called from another app using HttpURLConnection. I use IOUtils.copy() on the receiving side to save the file to disk.

It takes over 30 minutes to download a file. This is way too slow.

Ideas? Better implementations?

Answer

Brett Slocum picture Brett Slocum · Jul 20, 2012

I found the issue.

I was running both the client and the server on the same machine for testing. As soon as I moved one to a different machine, the transfer took a little over a minute.

Related questions

How to check if InputStream is Gzipped?

Is there any way to check if InputStream has been gzipped? Here's the code: public static InputStream decompressStream(InputStream input) { try { GZIPInputStream gs = new GZIPInputStream(input); return gs; } catch (IOException e) { logger.info("Input stream not in the GZIP format, …

Read More
HttpURLConnection downloaded file name

Is it possible to get the name of a file downloaded with HttpURLConnection? URL url = new URL("http://somesite/getFile?id=12345"); HttpURLConnection conn = (HttpURLConnection) url.openConnection(); conn.setRequestMethod("GET"); conn.setAllowUserInteraction(false); conn.setDoInput(true); conn.setDoOutput(true); conn.connect(); …

Read More
How to use java.net.URLConnection to fire and handle HTTP requests?

Use of java.net.URLConnection is asked about pretty often here, and the Oracle tutorial is too concise about it. That tutorial basically only shows how to fire a GET request and read the response. It doesn't explain anywhere how …

Read More