Which Protocol is best for File Transfer

Balamurgan picture Balamurgan · Aug 12, 2009 · Viewed 28.8k times · Source

What is the best protocol I can use to transfer a big file, which should be fast and reliable? It must support low bandwidth systems since I need a file transmission across India. The file size may be 100 to 500MB.

Answer

Dafydd Rees picture Dafydd Rees · Jan 9, 2010

Rsync is a great fit for this problem. It's designed to send/update big files remotely.

  • Runs from the command-line so you can launch it fairly easily as an external process.
  • It can synchronize two remote file systems.
  • It handles large file sizes.
  • It has a clever algorithm that seeks to only copy differences in files around.
  • It's widely implemented and is open source.
  • It has a throttling capability so you can limit how much of a WAN connection you're using up with the transfer so you can tune it to avoid starving other processes of connectivity.
  • internally uses zlib to compress transferred data blocks

original site: http://samba.anu.edu.au/rsync/

securing rsync with ssh: http://www.linux.com/archive/feature/113847

detailed features: http://en.wikipedia.org/wiki/Rsync