how do you add metainformation about the used ETL / ELT code (and version of this ELT code) to the produced sink files / tables?
Do u consider it as required to have information like "PipelineID" or "DataProductionTime" in the targetfolder?
how do you add metainformation about the used ETL / ELT code (and version of this ELT code) to the produced sink files / tables?
Do u consider it as required to have information like "PipelineID" or "DataProductionTime" in the targetfolder?
Copyright © 2021 Jogjafile Inc.
You can do it using the pipeline dynamic content and additional column in copy activity.
This is my source file:
In source of copy activity use additional column.
In ADF you can find meta information about the pipeline in System variables of dynamic content.
Target file in sink folder:
All this depends on your requirement like if you want to know by which pipeline you are getting data you can use this.