I have a managed kafka cluster running in the cloud on Aiven (GCP). I'm trying to use the Debezium SQL Server connector to stream CDC records from our on-premise database.
Does anybody know how to connect from kafka in the cloud to an on-premise database? Can this be done through some sort of VPN connection or do I need to configure a VPC through google cloud? Appreciate any advice.
You can use Debezium to stream CDC records from databases to a Kafka cluster, yes.
Here's an example with a different managed Kafka service, Confluent Cloud.
The main thing is getting your security settings right, as well as specifying the appropriate
database.history.consumeranddatabase.history.producerconfiguration.