Which is the best practice to define/handle BigQuery sharded tables like table_abc_* in Dataform?
Is there a way to reference them with ${ref(...)} and using a sort of _TABLE_SUFFIX syntax to select the one we need via variables? I was thinking to create a view on top of it selecting all the fields with the _table_suffix statement but this seems to me a workaround more than a way to define those in a proper way.
Defining Sharded BigQuery Tables on Dataform
301 Views Asked by Yak O'Poe At
1
There are 1 best solutions below
Related Questions in GOOGLE-BIGQUERY
- Get the last data of my google analytics dataset
- Is there any form to write to BigQuery specifying the name of destination tables dynamically?
- How to obtain java repositories having maximum number of stars in GitHub-Archive
- Possible to create BigQuery Table/Schema without populating with Data?
- Google spreadsheet script authorisation to BigQuery
- Google BigQuery Optimization Strategies
- Error when I try to create different BigQuery tables at the same pipeline execution
- Run BigQuery without login authentication
- Is there a CityHash Python (2.7) Implementation for Google App Engine?
- pandas read_gbq returns httplib.ResponseNotReady
- Designing an API on top of BigQuery
- BigQuery row level security permissions
- What is the best way to fuzzy compare two tables
- Query Google Bigquery Through Python In Google App Engine
- How to integrate Google Bigquery with c# console application
Related Questions in DATAFORM
- Can't add new item to Silverlight DataForm when ICollectionView is sorted or filtered
- Silverlight 4 DataForm Description Indicator - Can I use it without the DataForm
- databinding combobox in Dataform Silverlight using MVVM in Update
- Using Strophe Data-Form Library (toHTML, toXML)
- How to add several entries to a section from a moodle dataform?
- How to enable Workspace compilation override for a workspace in DataForm?
- BigQuery Dataform Assert Esecution issue
- What am I missing to get an output in this data entry form?
- dataform schema suffix for sources
- Can't figure out how to override variables in dataform
- Automating GCP Dataform Release Configuration Update via CI/CD Pipeline
- How do I invoke a Dataform workflow using assertions (Data Quality tests) Airflow via GCP Cloud Composer?
- Cannot add metadata to BigQuery views
- Post-processing with inculude javascript
- Dataform source declaration on Bigquery
Related Questions in GOOGLE-DATAFORM
- dataform schema suffix for sources
- Defining Sharded BigQuery Tables on Dataform
- Joining 2 tables and Optimization workflow using dataform
- Unable to connect to git hub repo from Dataform gcp
- Google Dataform incremental merge
- how execute a federated query in Google BigQuery with the federated query containing a variable
- Remote GitHub repository cannot be reached: generic::invalid_argument in GCP
- Getting "Intl is not defined" in Dataform GCP project
- GCP Dataform Upstream source check
- The Default Dataform SA unable to query INFORMATION_SCHEMA.JOBS_BY_ORGANIZATION
- Can we use promise in js blocks or .js files?
- Dataform reuse table confing in javascript
- Where is the repository stored that is created for Google Dataform?
- Execution of Google Dataform workflow gives error access denied
- Dataform - getting os username
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Quoting the answer I found on GitHub:
table_abc.sqlx
Then you can reference it in your other SQLX files as you wanted: