Compose a pipeline with other pipelines

Question

I am currently trying to choose between numerous workflow frameworks. I need an important feature which is workflow composition.

I found nothing on the documentation even in the API reference or advanced tutorial.

So my question is : Is it possible to compose pipelines ? i.e. To build some DAGs with already written ones. There is maybe some workarounds but I am interested by its native integration.

Thanks

Answer 1

I think you may be looking for the composite solid abstraction, which lets you compose sub-DAGs. https://docs.dagster.io/tutorial/advanced_solids#composite-solids https://docs.dagster.io/_apidocs/solids#composing-solids