[spring-kafka]: Edit log.retention.bytes after kafka topic is created

Question

We are using Debezium + spring-boot + spring-kafka in our java app. Debezium code will automatically create a few kafka topics. Is it possible to modify those topics' properties using spring-kafka?

Can we set some property in application.properties OR modify debezium configuration to achieve this?

Thank you!

Answer 1

I presume you mean the retention.bytes topic property; log.retention.bytes is a broker property.

The issue I previously reported here was with a typo in the config name; the following should always work.

spring.kafka.admin.modify-topic-configs=true

@Bean
ApplicationRunner runner(KafkaAdmin admin) {
    return args -> {
        admin.createOrModifyTopics(TopicBuilder.name("topic1")
                .config("retention.bytes", "100000")
                .partitions(1)
                .replicas(1)
                .build());
    };
}

You can also just declare it as a bean and the framework will make the call for you:

@Bean
NewTopic topic() {
    return TopicBuilder.name("topic1")
            .config("retention.bytes", "200000")
            .partitions(1)
            .replicas(1)
            .build();
}