Can I have a data-pipeline as a part of my cloud-formation template?

2.4k Views Asked by At

My app has a S3 bucket with daily feeds, 2 DynamoDB tables that stores this data, an ELB application that exposes the JSON API to that data and a data pipeline flow that processes the incoming data and uploads into the tables.

My CloudFormation template currently builds the tables and the ELB app. I'd want the pipeline flow to be a part of the template too (so a complete staging environment, for example, will be built together).

I couldn't find references for that in the manuals. Does anyone know how to do it or can confirm that it's officially not supported?

Zach

1

There are 1 best solutions below

5
On BEST ANSWER

Editing my previous answer as Cloudformation has been supporting Data Pipeline.

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-datapipeline-pipeline.html

As @SmartFingers noted, Data Pipeline is offered in fewer regions (although AWS has been adding) than Cloudformation itself.

https://aws.amazon.com/about-aws/whats-new/2014/02/20/aws-data-pipeline-now-available-in-four-new-regions/