How to get response from HTTP Sink Plugin in Cloud Data Fusion?

349 Views Asked by At

Expertise: I am new to Cloud Data Fusion.

What I am trying to achieve: Create a Data pipeline in the Google Cloud Data Fusion:

  1. Read a file from GCS.
  2. Call an HTTP Endpoint with the parsed data of GCS.
  3. Save the response received from HTTP in the GCS file.

enter image description here

However, it seems HTTP Plugin(Sink) doesn't have the capability to receive the data back from the endpoint.

1

There are 1 best solutions below

3
MBHA Phoenix On

Probably you cloud fusion is on a private network, your http endpoint is exposed on the internet so you can contact it but you cannot receive the response. Cloud Nat is usually used for this kind of requirements.