Copy file from remote server using SFTP straight to Azure blob storage

azure azure-worker-roles azure-storage-blobs
Lance Bloom picture Lance Bloom · Nov 18, 2014 · Viewed 10.1k times · Source

I've got a remote server with a bunch of static files (outside of Azure). I've created a worker role in Azure and I want to use the worker role to transfer these files using SFTP from my remote server straight to my blob storage account (without copying locally to the worker role). Is there an established workflow/best practices on how to do this?

The closest thing I was able to find was this question: Copy file from URL to Azure BLOB

However to use StartCopyFromBlob I would need to have a publicly accessible URL which is not the case.

Also some of these files may be >100mb or >500mb, should that raise any problems?

Thanks.

Answer

Mark Volders picture Mark Volders · Nov 19, 2014

You might want to tackle this the other way around, by setting up an FTP server on Azure which save the files directly to Azure storage.

A good explanation on how to do this by use of the Preview Files can be found on http://fabriccontroller.net/blog/posts/deploying-a-load-balanced-high-available-ftp-server-with-azure-files/

Related questions

FTP to Azure Blob Storage

I had to setup secure FTP to Azure Blob Storage using popular FTP clients (like FileZilla, for example). After doing lot of research, I came across a link that says: Deployed in a worker role, the code creates an FTP …

Read More
How to upload a folder to Blob Storage?

I have a worker role that I use to pull data down from Blob Storage OnStart. Currently I'm testing this by uploading a test.txt file and then downloading it to a local directory. This is working fine. I now …

Read More
In Windows Azure: What are web role, worker role and VM role?

The application I work on contains a web role: it's a simple web application. I needed to host the application in Windows Azure, so I created a web role. I actually want to know what these roles are for. What …

Read More