I'm building a serverless web application using: API-gateway, S3, DynamoDB, Cloud Formation, ... I have come to a point where I'm adding a new feature that requires some data in S3 and DynamoDB to be migrated. I could of course write a one-off script that would do the job, but I was wondering if there are any good structural solutions out there?
I found https://github.com/sequelize/umzug but didn't look any deeper yet. Any reviews?
I'm particularly interested to learn how a data migration might work where there is an infrastructure change, e.g. data in one S3 bucket is migrated into a new S3 Bucket and a DynamoDB table. Anybody has some experience with this?
Many thanks!
In general we have "Data Migration Service" and "Schema conversion tool" to migrate between different DB engines. Also look at "AWS Data Pipeline" ..
To answer your question; it will depend on your requirements. To give you few examples; you can directly migrate data from one S3 bucket to other using a AWS CLI command "aws s3 cp" if there is no conversion needed in between. for example: You can copy data from S3 to redshift using "copy" command.