Quick way to list all files in Amazon S3 bucket?

Steve picture Steve · Jul 26, 2010 · Viewed 233.5k times · Source

I have an amazon s3 bucket that has tens of thousands of filenames in it. What's the easiest way to get a text file that lists all the filenames in the bucket?

Answer

Zachary Ozer picture Zachary Ozer · Jul 27, 2010

I'd recommend using boto. Then it's a quick couple of lines of python:

from boto.s3.connection import S3Connection

conn = S3Connection('access-key','secret-access-key')
bucket = conn.get_bucket('bucket')
for key in bucket.list():
    print key.name.encode('utf-8')

Save this as list.py, open a terminal, and then run:

$ python list.py > results.txt