Debezium Server source connector for GCP cloud SQL Server without Kafka

73 Views Asked by At

I am trying to use Debezium server (Standalone without Kafka) to load data (incremental) from GCP Cloud SQL Server to PubSub and then BigQuery.
I am running a test on my laptop to see if that's doable. I set up debezium server on docker this is my docker-compose.yaml

If I remove SQL Server it works (debezium server starts on docker), am I even on the right track? Should I define the source (GCP SQL Server) on here?

sqlserver:
image: mcr.microsoft.com/mssql/server:2019-latest
container_name:sqlserver
ports:
 - 1433:1433
environment:
 - ACCEPT_EULA=Y
 - MSSQL_PID=Standard
 - SA_PASSWORD=Password!
 - MSSQL_AGENT_ENABLED=true

services:

debezium-server:
image: quay.io/debezium/server
container_name: debezium-server
environment:
  GOOGLE_APPLICATION_CREDENTIALS: /tmp/credentials/service-account.json
ports:
  - "8080:8080"
volumes:
  - ./demo-sa.json:/tmp/credentials/service-account.json
  - ./conf:/debezium/conf
depends_on:
  - sqlserver
restart: "always"
0

There are 0 best solutions below