Import file data from S3 into RDS with transformation steps

606 Views Asked by At

I'm a novice AWS user and I'm trying to solve a use case where I need to import data from a csv that is dropped into an S3 bucket to RDS.

I have a csv file that will be uploaded to an S3 bucket, from there I want to run a custom Python script to run against that data, this script will build a set of metrics/scoring against the data. Next, I'd like to transform that output data from the Python script (to build multiple tables), and load it into tables to fit my RDS database schema.

I took a look at AWS Data Pipeline and AWS Glue but I'm not quite sure what services to use. Any ideas would be greatly appreciated.

0

There are 0 best solutions below