Bash Script To Sync Directory With S3

To secure critical backup remotely, we can use S3 bucket. Here is a bash script to sync a directory to/from a S3 bucket.

Bash Script To Sync Directory With S3



  • We should avoid uploading the same files to S3, since it wastes your money and takes longer.
  • If too many files to sync, we’d better launch multiple parallel tasks of S3.
  • Two tips to lower your cost of S3 for archiving. Try S3 RRS bucket, if possible; Enable S3 lifecycle management with Glacier.

Here is the code in Github. GitHub

github_s3sync.png

linkedin
github
slack

PRs Welcome

Blog URL: https://www.dennyzhang.com/sync_s3_directory


Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.