Error reporting for Dataflow

826 Views Asked by At

Is there a way to send notifications when an error happens in Dataflow ?

Is it possible to integrate it with something like Sentry ?

Or maybe with Stackdriver or Google Cloud's error reporting service ?

1

There are 1 best solutions below

1
On BEST ANSWER

I believe it is possible through the following configuration:

  • Dataflow logs are streamed into Google Cloud Logging.
  • Create a custom log based metric in Google Cloud Logging.
  • Create an alert policy in Google Cloud Monitoring (Stackdriver) based on the custom log based metric.