Data Fusion not allow Struct type from Bigquery

254 Views Asked by At

I'm try create a pipeline on Datafusion to read a table from bigquery with STRUCT type but received this error:

2021-06-01 19:13:53,818 - WARN  [service-http-executor-1321:i.c.w.s.c.AbstractWranglerHandler@210] - Error processing GET /v3/namespaces/system/apps/dataprep/services/service/methods/contexts/interoper_prd/connections/interoper_bq_prd/bigquery/raw_deep/tables/deep_water_report/read?scope=plugin-browser-source, resulting in a 500 response.
java.lang.RuntimeException: BigQuery type STRUCT is not supported
1

There are 1 best solutions below

0
On

I was able to reproduce your issue. For this reason, I have opened an Issue within GCP Issue Tracker platform, here.

The product team is already aware of the complaint, as you can see in the case comments. Please follow the thread for any updates.