I'm creating a stream from Oracle through Kafka to Azure and am wondering if Debezium is any good for that. It seems to fit the bill but when I look at the data sent through Kafka I'm worried about the efficiency. The packets don't seem to be lean-and-mean but quite large.
Does anybody have experience with a setup with about 4000 mutations/sec over a line from on-prem to Azure? The line is about 500Mbit but is shared with others...
I am leaning towards using my own simple format to transport the packets to Azure and only over there convert them to Debezium for ingestion in the rest of the pipeline.
Thanks, Milo