Was using the GCP data transfer service to transfer a set of files in an S3 bucket over to a GCP storage bucket. The files were in glacier so I first restored them and then tried copying them. The transfer job runs without any errors, but ignores any of the glacier restored files. Is this the expected behavior? And if it is then it seems like a huge oversight not to mention this in the documentation. I could easily imagine a scenario where you think you've mirrored a bucket when you really haven't.
Using GCP Data Transfer Service to transfer files from S3 previously stored in glacier
164 Views Asked by Joe Slagel At
0
There are 0 best solutions below
Related Questions in GOOGLE-CLOUD-PLATFORM
- Why do I need to wait to reaccess to Firestore database even though it has already done before?
- Unable to call datastore using GCP service account key json
- Troubleshooting Airflow Task Failures: Slack Notification Timeout
- GoogleCloud Error: Not Found The requested URL was not found on this server
- Kubernetes cluster on GCE connection refused error
- Best way to upload images to Google Cloud Storage?
- Permission 'storage.buckets.get' denied on resource (or it may not exist)
- Google Datastream errors on larger MySQL tables
- Can anyone explain the output of apache-beam streaming pipeline with Fixed Window of 60 seconds?
- Parametrizing backend in terraform on gcp
- Nonsense error using a Python Google Cloud Function
- Unable to deploy to GAE from Github Actions
- Assigned A record for Subdomain in Cloud DNS to Compute Engine VM instance but not propagated/resolved yet
- Task failure in DataprocCreateClusterOperator when i add metadata
- How can I get the long running operation with google.api_core.operations_v1.AbstractOperationsClient
Related Questions in GOOGLE-CLOUD-STORAGE
- Permission 'storage.buckets.get' denied on resource (or it may not exist)
- Parametrizing backend in terraform on gcp
- Download file from GCP bucket without using decompressive transcoding by default
- CORS Error When Fetching File From Firebase Storage
- Google cloud storage: move specific zip files from one bucket to another
- Flutter upload file to Firebase storage
- Deploy Springboot app on heroku which is using google storage services
- List all the files in firebase storage date wise and zip it using cloud function
- How to Handle NUL (ASCII 0) Data Error When Loading TSV GZIP File from Google Cloud Storage into BigQuery
- getting ValueError: Cannot determine path without bucket name
- GCP Workload Identity Federation in java
- How to find a file with specific file name pattern in GCS bucket using Python
- getSignedURL() called from firebase cloud function gives permission denied error ( firebase-functions v2)
- Clone/ Backups for BigQuery Project
- NGINX won't run alongside Google Cloud Storage FUSE in Docker container
Related Questions in GOOGLE-CLOUD-DATA-TRANSFER
- Creating a Basic Google Ads Campaign Report using Bigquery Transfer Data
- Architecture of app with lots of data transfer
- Big Query SA360 Data Transfer Error - Permission denied: the SA360 user does not have read access to the report scope
- Data transfer from Google ADs to Google Big Query
- Is it possible to backfill in bq data tranfer service with s3 as data source?
- BigQuery Data Transfer for Google Play - Missing New Users/Returning Users Metric
- Data Transfer From GCS to Google BQ Failed
- Long Delay in transfer of 74GB CSV from AWS S3 to BigQuery using Big Query Data Transfer Service
- YouTube Data Transfer high views
- Where do I find search terms for shopping campaigns in Google Ads data transfer service tables
- How do I exclude a filename that contains '_All_Data' when using the Data Transfer feature on BigQuery?
- Get details of All Class A operations in GCP Cloud Storage to Understand Cost
- No Cloud Storage Audit Logs for Data Transfer Service
- Alternative for skip operation's cost overhead : --no-clobber in CP operation of GCP
- gcloud storage cp : skipping already copied file into destination bucket
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?