Creating an Amazon EC2 Backup solution to Amazon S3

backup amazon-s3 remote-backup
Geniuswood picture Geniuswood · Sep 15, 2009 · Viewed 12.4k times · Source

I currently use Amazon S3 as a backup location for my local machines - Primarily using JungleDisk to backup nightly all my local files to my S3 account.

I have been looking at creating a more intelligent backup solution for remote files - Websites on Windows and Linux boxes, along with SQL Server and MySQL databases.

I have been pondering the idea of creating an Amazon EC2 instance which can operate in the cloud as my remote backup machine - Ideally, some sort of script or schedule would trigger the machine to start, and when it does, it would execute a variety of tools or scripts to connect to and back-up my web servers, backing everything up to my Amazon S3 account. Hopefully, when complete the instance can be programmed to shut-down saving execution time.

Am I dreaming? Is this a possibility? Can anyone point me in the right direction?

Thanks,

GW

Answer

Kieran picture Kieran · Oct 22, 2009

I had the exact same thought about getting an EC2 instance to be my dynamic rsync machine. Just wrote an entry about it on our blog, but basically the solution is indeed to create an EC2 volume, not S3 and dynamically startup and shutdown an EC2 instance, mount the volume and rsync to it whenever you want to backup.

See my entry here: Using Amazon EC2/EBS/S3 for automated backups

Related questions

Backup strategies for AWS S3 bucket

I'm looking for some advice or best practice to back up S3 bucket. The purpose of backing up data from S3 is to prevent data loss because of the following: S3 issue issue where I accidentally delete this data from …

Read More
Backup AWS Dynamodb to S3

It has been suggested on Amazon docs http://aws.amazon.com/dynamodb/ among other places, that you can backup your dynamodb tables using Elastic Map Reduce, I have a general understanding of how this could work but I couldn't find …

Read More
s3cmd failed too many times

I used to be a happy s3cmd user. However recently when I try to transfer a large zip file (~7Gig) to Amazon S3, I am getting this error: $> s3cmd put thefile.tgz s3://thebucket/thefile.tgz .... 20480 of 7563176329 0% …

Read More