The system requirements for Confluent Control Center state that 500GB disk space is required. CCC appears to store some data in Kafka itself, so can someone please tell me what this storage is actually required for? i.e. what is preventing CCC from being deployed as a container in Kubernetes without persistent volume storage?
Confluent Control Center disk space requirements - why so large?
819 Views Asked by John At
1
There are 1 best solutions below
Related Questions in APACHE-KAFKA
- Spark streaming + kafka throughput
- How to diagnose Kafka topics failing globally to be found
- kafka: what do 'soTimeout', 'bufferSize' and 'minBytes' mean for SimpleConsumer?
- Fail to create SparkContext
- Syntax error on tokens, delete these tokens - kafka spring integration demo application
- How could Kafka 0.8.2.1 with offsets.storage=kafka still require ZooKeeper?
- Message Queues: Per Message Guarantees
- How should a Kafka HLC figure out the # of partitions for a topic?
- Kafka multiple consumers for a partition
- Should Apache Kafka and Hadoop be installed seperatedly (on a diffrent cluster)?
- how does one combine kafka-node producer and node tail?
- How to fix NoClassDefFoundError with custom Kafka producer under Eclipse?
- Apache Samza's CheckpointTool won't give away partition offsets
- Offsets for Kafka Direct Approach in Spark 1.3.1
- Simulate kafka broker failures in multi node kafka cluster and what operations and tools to use to mitigate data loss issues
Related Questions in CONFLUENT-PLATFORM
- confluent kafka hdfs connector hive
- Kafka connect Insert Into field with analyzer
- Confluent Kafka Avro Serializer, Server Project Code Dependency? VerifiableProperties?
- Confluent server went down
- How to reset the offset in REST proxy for reconsuming Kafka messages?
- Can we use "oneOf" in Confluent Platform Schema Registry?
- How to read batch messages in confluent kafka python?
- Cannot print Kafka Avro decoded message
- SSL confluent-kafka-dotnet librdkafka SSL
- Passing parameter Name in confluent HDFS Connector
- Failed to construct kafka producer
- How do I set up confluent docker to be accessed externally, based on confluent docker quickstart
- java.lang.NoSuchMethodError: com.google.common.collect.Sets$SetView.iterator()Lcom/google/common/collect/UnmodifiableIterator;
- Confluent Kafka Avro deserializer for spring boot kafka listener
- How to use confluent-kafka with the key store file
Related Questions in CONFLUENT-CONTROL-CENTER
- Kubernetes - Confluent Kafka Control Center Ingress Routing
- Confluent control-center keeps quotes to the string key
- Set up Confluent Metrics Reporter at wurstmeister/kafka
- Confluent control-center -INFO Restored batch for store [MetricsAggregateStore] with topic-partition
- How to setup Confluent on a 3-node Ubuntu machines
- connect self managed ksqlDB to Confluent Cloud | managed ksql server
- Docker image for Confluent - adding Confluent Hub connectors
- How to check who is active controller(broker id) from kafka connect log file
- Receiving strange values to kafka topic from kura
- LDAP bind authentication with Jetty
- Invalid Schema on Confluent Controlcenter
- Confluent Connect on Different Port Not Working
- confluent control-center directory not found in confluent-5.5.3
- Can't install confluent-control center
- why No new messages seen in ksql even messages exist?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Yes, Control Center maintains some data back in Kafka for rolling aggregates, but it's using Kafka Streams to do that, which is configured with a RocksDB database, and can store that information on disk.
The latest documentation says less than 500GB, though.
If you have used Control Center, you would know that you can access months of Kafka historical metrics.
300 GB isn't really that much, when look at your average Oracle or SQL Server database at most companies.
Other than being able to retain historical data, and have a slow start-up period on the pod rebooting and getting data, probably not much.
8 cores and 32 GB of RAM to a container, though, might make one heavy pod.