How to copy data from Amazon AWS S3 Bucket into a MariaDB SQL table in Apache Airflow

341 Views Asked by At

In Airflow I know that you can use SQLToS3Operator to copy data from an SQL database to an S3 bucket, but I need it to go the other way; copying data from an S3 bucket into an SQL database. This would specifically be copying keys into a table, one key per table, into a locally hosted MariaDB SQL database just on my computer through Docker. Any ideas?

1

There are 1 best solutions below

0
On

You can use S3ToMySqlOperator which works with mariadb too.