Error when creating materialized view on datastream enabled Bigquery tables

287 Views Asked by At

We have tables in bigquery that are populated using datastream from postgres. We want to create materialized views on top of these bigquery tables but we run into the following error

Materialized views has a base table with unapplied Change Data Capture(CDC) upsert data within a configured period.

1

There are 1 best solutions below

0
On

As mentioned in this PIT issue and this public documentation, materialized views over the BigQuery table that has upsert data is not supported. The Change Data Capture(CDC) is used to update the BigQuery tables by processing and applying streamed changes to existing data which is also called as upserting the data. Since the MV’s over the table that has upsert data is not supported, you are getting the error.

However, there is a feature request filed for the same. You can vote for this feature by clicking +1 and STAR mark to receive updates on it.