s3cmd-util

Description

s3cmd in a Docker container. This is useful if you are already using Docker. You can simply pull this container to that Docker server and move things between the local box and S3 by just running a container.

Using Alpine linux. This image is 31MB.

You can find an automated build of this container on the Docker Hub: https://hub.docker.com/r/rogaha/s3cmd-util/

Usage Instruction

Copy from local to S3:

AWS_ACCESS_KEY_ID=<YOUR AWS KEY>
AWS_SECRET_ACCESS_KEY=<YOUR AWS SECRET>
S3_URL=s3://rogaha.public.S3_URL/database2/
LOCAL_DIR=/tmp/database

docker run \
--env AWS_ACCESS_KEY_ID=${AWS_ACCESS_KEY_ID} \
--env AWS_SECRET_ACCESS_KEY=${AWS_SECRET_ACCESS_KEY} \
--env CMD=sync-local-to-s3 \
--env DEST_S3=${S3_URL}  \
-v ${LOCAL_DIR}:/opt/src \
rogaha/s3cmd-util

• Change LOCAL_DIR to folder you want to upload to S3

Copy from S3 to local:

AWS_ACCESS_KEY_ID=<YOUR AWS KEY>
AWS_SECRET_ACCESS_KEY=<YOUR AWS SECRET>
S3_URL=s3://bucket_name/tmp
LOCAL_DIR=/tmp

docker run \
--env AWS_ACCESS_KEY_ID=${AWS_ACCESS_KEY_ID} \
--env AWS_SECRET_ACCESS_KEY=${AWS_SECRET_ACCESS_KEY} \
--env CMD=sync-s3-to-local \
--env SRC_S3=${S3_URL} \
-v ${LOCAL_DIR}:/opt/dest \
rogaha/s3cmd-util

• Change LOCAL_DIR to the folder where you want to download the files from S3 to the local computer

Run interactively with s3cmd

AWS_ACCESS_KEY_ID=<YOUR AWS KEY>
AWS_SECRET_ACCESS_KEY=<YOUR AWS SECRET>

docker run -it \
--env AWS_ACCESS_KEY_ID=${AWS_ACCESS_KEY_ID} \
--env AWS_SECRET_ACCESS_KEY=${AWS_SECRET_ACCESS_KEY} \
--env CMD=interactive \
-v /:/opt/dest \
rogaha/s3cmd-util /bin/sh

Then execute the main.sh script to setup the s3cmd config file

/opt/main.sh

Now you can run s3cmd commands

s3cmd ls /