Is it possible to backfill in bq data tranfer service with s3 as data source?

60 Views Asked by At

I need to schedule a backfill for my data using bigquery Data Tranfer Service, with s3 as source.

But it doesn't seems to work following the doc from here

I select run for specific date and set to july, 2023, although Transfer load date is changed according to the image below, but in the 2nd log it still tranfer files as defult modified date, which is between 2023-11-18 and 2023-12-07: enter image description here

What I need to do is transfer files modified before 2023-11-18, like below: enter image description here

0

There are 0 best solutions below