I'm working with a Stream job from an Oracle database to Biguery using Datastream, and some of the tables are transactional so I'm wondering if I can alter some of them (created automatically by Datastream) to add partition and/or clustering, to improve performance and reduce billing. I know Bigquery doesn't let me add a partition to an existing table, but can I recreate it (with the partition + clustering) and then let the Stream to use the table?
Can I alter a BQ destination table from Datastream for better performance?
108 Views Asked by Favio Zúñiga At
0
There are 0 best solutions below
Related Questions in GOOGLE-BIGQUERY
- Get the last data of my google analytics dataset
- Is there any form to write to BigQuery specifying the name of destination tables dynamically?
- How to obtain java repositories having maximum number of stars in GitHub-Archive
- Possible to create BigQuery Table/Schema without populating with Data?
- Google spreadsheet script authorisation to BigQuery
- Google BigQuery Optimization Strategies
- Error when I try to create different BigQuery tables at the same pipeline execution
- Run BigQuery without login authentication
- Is there a CityHash Python (2.7) Implementation for Google App Engine?
- pandas read_gbq returns httplib.ResponseNotReady
- Designing an API on top of BigQuery
- BigQuery row level security permissions
- What is the best way to fuzzy compare two tables
- Query Google Bigquery Through Python In Google App Engine
- How to integrate Google Bigquery with c# console application
Related Questions in DATA-PARTITIONING
- Why Google BigQuery doesn't use partition date correctly when using views
- Hashing VS Indexing
- Cassandra not balancing data over existing nodes in cluster
- Slice a PowerShell array into groups of smaller arrays
- Spark partition by files
- Preserving the number of partitions of a Spark dataframe after transformation
- Maximum Coin Partition
- MATLAB: Partition vector in multiple parts using begin and end indices
- Haskell - Match Type Instance
- Keyby data distribution in Apache Flink, Logical or Physical Operator?
- R - Applying formula through partitioning a dataset
- R's caTools Sample.Split Results Incorrect
- Algorithm to partition a list into groups
- Generate all partitions of integer array
- What is hybrid-columnar storage?
Related Questions in CHANGE-DATA-CAPTURE
- SQL Server Change Data Capture - Capture user who made the change
- Could not update the metadata that indicates database X is enabled for Change Data Capture. The error returned was 15517
- Postgres/JDBC/Logical replication - out of memory issues
- Leaving Change Data Capture cleanup disabled?
- How to get all the datetime values coming from debezium to yyyy-mm-dd-ss.zzz format
- salesforce Change Data Capture not sending change event
- Change Data Capture for several tables
- MS SQL Server: using CDC to populate single destination table from several source tables
- Trouble with Change Data Capture in SQL Server 2008 R2
- How to know which column's value is changed in CDC
- How to get Selected Entities in Salesforce.com Change Data Capture using force-partner-api-55.2.jar?
- Can I alter a BQ destination table from Datastream for better performance?
- How to hash multiple columns of different types in Trino/Athena
- Understanding and Resolving Azure SQL Managed Enable Reboots During CDC Installation
- wal streaming and logical replication slot: offset of stream
Related Questions in GOOGLE-DATASTREAM
- Google Cloud's Datastream: Not replicating deletes to BigQuery
- Can I alter a BQ destination table from Datastream for better performance?
- Bigquery SELECT query cost much higher than table size
- How can I use cloud SQL (postgres) server as SSH host to connect from Datastream?
- Connecting Datastream to Cloud SQL postgres over private IP: Do I need a reverse proxy even if they are in the same project?
- How to change mapping of dataflow job (datastream to spanner template)
- Dataflow polling not being able to see new entries
- Datastream - the costs of root partitioned table from PostgreSQL to BigQuery
- Tables with unapplied upsert data cannot be queried through prefix (query to INFORMATION_SCHEMA.PARTITIONS)
- Error when creating materialized view on datastream enabled Bigquery tables
- How to understand Google Cloud Datastream UNSUPPORTED_EVENTS_DISCARDED
- Not able to connect the oracle database to GCP data-stream
- GA4 - filtering retail and wholesale traffic
- Use Terraform on Google Cloud SQL Postgres to create a Replication Slot
- BigQuery removes fields with Postgres Array during datastream ingestion
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?