How can I use wildcards to `cp` a group of files with the AWS CLI

metersk picture metersk · Aug 8, 2016 · Viewed 65k times · Source

I'm having trouble using * in the AWS CLI to select a subset of files from a certain bucket.

Adding * to the path like this does not seem to work

aws s3 cp s3://data/2016-08* .

Answer

punkrockpolly picture punkrockpolly · Aug 8, 2016

To download multiple files from an aws bucket to your current directory, you can use recursive, exclude, and include flags like this:

aws s3 cp s3://data/ . --recursive --exclude "*" --include "2016-08*"

For more info on how to use these filters: http://docs.aws.amazon.com/cli/latest/reference/s3/#use-of-exclude-and-include-filters