Copy old data from local Centos to AWS S3 bucket

Asked Feb 16 '21 at 22:30

Active Feb 19 '21 at 17:14

Viewed 213 times

I have the following task to complete. I hope someone can provide the feedback to get me started.

We have a directory with thousands of images in many folders and sub-folders
The goal is to have a script run through the images and move anything older than 1 year to AWS S3
The directory structure should be preserved in S3 and the images should be removed from the source.

PS: I already have a connection to AWS from the instance and the IAM user was created as well.

Any ideas will be much appreciated.

edited Feb 19 '21 at 17:14

Dave M

asked Feb 16 '21 at 22:30

Carlos Lijeron

Use rclone. To move files or directories instead of sync/copying those, use rclone move. See this answer. – mforsetti Feb 18 '21 at 08:52
Does this answer your question? Rsync to AWS S3 bucket – mforsetti Feb 18 '21 at 08:53

0 Answers0