Amazon S3 with s3fs and fuse. script to unmount and mount

bash amazon-web-services amazon-s3 fuse s3fs
ilansch picture ilansch · Dec 30, 2012 · Viewed 7.9k times · Source

Redhat with Fuse 2.4.8
S3FS version 1.59

In addition to: Amazon S3 with s3fs and fuse, transport endpoint is not connected

I would like to make a script to fix the situation. The script will unmount and mount the the directory. the commands i need to use are:
fusermount -u /s3
/usr/bin/s3fs -o allow_other bucketname /s3

For people who familiar with this situation, should I be concerned with something else ? or this is enough ?

Answer

Michel Feldheim picture Michel Feldheim · Dec 30, 2012

You shouldn't use amazon s3 as a unix file system in a productive environment. S3 is not built like this. From the s3fs docs

Important Limitations Eventual Consistency Due to S3's "eventual consistency" limitations file creation can and will occasionally fail. Even after a successful create subsequent reads can fail for an indeterminate time, even after one or more successful reads. Create and read enough files and you will eventually encounter this failure. This is not a flaw in s3fs and it is not something a FUSE wrapper like s3fs can work around. The retries option does not address this issue. Your application must either tolerate or compensate for these failures, for example by retrying creates or reads. For more details, see Eventual Consistency

Related questions

How to use AWS S3 CLI to dump files to stdout in BASH?

I'm starting a bash script which will take a path in S3 (as specified to the ls command) and dump the contents of all of the file objects to stdout. Essentially I'd like to replicate cat /path/to/files/* except …

Read More
Can bash script be written inside a AWS Lambda function

Can I write a bash script inside a Lambda function? I read in the aws docs that it can execute code written in Python, NodeJS and Java 8. It is mentioned in some documents that it might be possible to use …

Read More
List public IP addresses of EC2 instances

I want to list the public IP addresses of my EC2 instances using Bash, separated by a delimiter (space or a new-line). I tried to pipe the output to jq with aws ec2 describe-instances | jq, but can't seem to isolate …

Read More