Flink: Wait for Kafka CDC to playback from earliest-offset at start up

104 Views Asked by At

I am trying to implement a way to wait until the table kafka-connector has caught up with the latest offset.

I've already tried implementing a session gap window operator on that table (kafka-connector to a compact topic) to wait for inactivity on the table and then collect the result locally (in an attempt to close the operator/task) but it became a global operator and the rest of my topology doesn't get executed (because this window operator creates a disjoint topology)

0

There are 0 best solutions below