I'm try create a pipeline on Datafusion to read a table from bigquery with STRUCT
type but received this error:
2021-06-01 19:13:53,818 - WARN [service-http-executor-1321:i.c.w.s.c.AbstractWranglerHandler@210] - Error processing GET /v3/namespaces/system/apps/dataprep/services/service/methods/contexts/interoper_prd/connections/interoper_bq_prd/bigquery/raw_deep/tables/deep_water_report/read?scope=plugin-browser-source, resulting in a 500 response.
java.lang.RuntimeException: BigQuery type STRUCT is not supported
I was able to reproduce your issue. For this reason, I have opened an Issue within GCP Issue Tracker platform, here.
The product team is already aware of the complaint, as you can see in the case comments. Please follow the thread for any updates.