Talend Open Studio for Big Data

Question

there are several servers that each one is including 100 files separately. how I am able to get files from different servers and save them in the different folders through one FTP connection in Talend.

Does anyone have any insight on how to download all files from an FTP? thanks in advance.

Answer 1

Create as many servers you want to connect, 'n' csv files containing these lines:

• host;server_ip
• port;port
• user;user
• password;password
• ftp_directory;remote_dir
• local_directory;local_dir
• file_mask;file_mask

These files will be loaded to the context of the job, so we need to create context variables with the same names used in the files, Then create your job like this:

• tFileList: iterate on context files created in first step
• tFileInputDelimited: read the current file of tFileList: ((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))
• tContextLoad: load context variables from current file
• tFTPGet: use all the context variables as settings