Create a file list in IICS informatica and load the files to a table

271 Views Asked by At

I want to load a bunch of files with the same structure and same name format(ABCD_MMYYDD) every month from local folder to Snowflake table. The server we use is a windows server. So I wanted to know how can configure iics so that similar filenames are picked up and loaded. Currently we use filewatcher to create a file list and then use that to load the files.Do we have any other alternatives to this?

1

There are 1 best solutions below

0
Maciejg On BEST ANSWER

There are two ways:

  • run the process on schedule (e.g. every 8 hours), process would start by running a script that prepares a list of available files and load all of them and archive the files after loading. This is an alternative. Pros: no file listener needed. Cons: it runs on a fixed schedule, files are not loaded as-they-come
  • keep using the filewatcher as you are. Pros: files loaded right after arrival. Cons: filewatcher, multiple process spawned.