How can I transfer data from an EBS volume to a S3 bucket?

amazon-web-services amazon-s3 amazon-ebs
CoreCoder picture CoreCoder · Jul 10, 2014 · Viewed 7.6k times · Source

I have about 400 GB data on an Amazon EBS volume and I need this data in a S3 bucket for Hadoop EMR usage.

How can I move/copy data from an EBS volume to a S3 bucket (both S3 bucket and EBS volume are in the same AWS region)?

Thanks

Answer

razimbres picture razimbres · May 10, 2018

Firstly get your credentials at AWS via IAM:

Go to AWS/Services/IAM select Users and create an Administrator. After that, download your credentials.csv and run in shell:

aws configure

Enter your Access key ID and Secret access key.

Then copy files and folders from EBS in EC2 to S3:

aws s3 sync /ebs-directory/ s3://your-bucket​

Related questions

How to make a daily back up of my ec2 instance?

I have a community AMI based Linux EC2 instance in AWS. Now I want to take a daily back up of my instance, and upload that image in to S3. Is that the correct way of doing the back up …

Read More
EC2 - taking an EBS snapshot, saving to S3, and then launching instances from S3

I like the convenience of taking an AMI snapshot - but ideally I do no want to pay for the volume to be attached to my running instance. Is there a way to save a snapshot instance to S3 and …

Read More
Should I persist images on EBS or S3?

I am migrating my Java,Tomcat, Mysql server to AWS EC2. I have already attached EBS volume for storing MySql data. In my web application people may upload images. So I should persist them. There are 2 alternatives in my mind: …

Read More