iam beginner using druid and kafka.
I want to create interactive data realtime kafka-druid. I still confuse what tuning should i change of this configuration?
Thank in advance
Druid Tuning Configuration
201 Views Asked by Handri Mauludin Maulana At
1
There are 1 best solutions below
Related Questions in DRUID
- Druid runtime properties
- Data Ingestion from kafka is not happening as expected
- Failed to sample data: com.google.protobuf.Descriptors$DescriptorValidationException: ".google.protobuf.Timestamp" is not defined
- Druid appending "StructuredData{value=" with LATEST Aggregation on JSON type column object
- OOM error with data upload from MySQL table into Apache Druid using JSON task
- Steps to add indexer tiers in druid
- Question about Druid Error in Custom Order By Query
- errorClass'in superset when filtering a druid query from the dashboard
- markUsed is not marking segments as unUsed in druid
- Docker Kafka broker not starting no error logs
- Aggregate function for compressed big decimal in Druid
- Druid Datadog integration not displaying any metrics
- Unable to connect to kafka from druid
- How to add Javascript extraction function in Druid?
- How to load delimited file with apache druid
Related Questions in DATABASE-TUNING
- How can I fix MySQL replication lag on Windows when slave_io and slave_sql are both running with 'copy to tmp table' in Slave_SQL_Running_State?
- Oracle Database performance tuning (on database level)
- what should be minimum ratio of dead tuple for a table to be considered for VACUUM FULL in Postgres
- AttributeError: Can't get attribute 'TunerInternal._validate_overwrite_trainable' on <module 'ray.tune.impl.tuner_internal'
- how to tune postgres for IO waits
- Does Automatic tuning in Azure SQL Database reorganize and rebuild indexes?
- Add index and partitioning for Postgress table
- I need to change the temp table to a CTE in part of my Stored Procedure
- SELECT query waiting on DataFileWrite in Postgres
- Tuning Azure Postgres PAAS (100% memory usage)
- Druid Tuning Configuration
- Oracle-Java | Update 6000 rows in 30 Mins to 1 hour| A Non Primary Non Indexed composite key
- Oracle expdp and impdp command?
- Performance issue - max_elapsed_time
- Mysql total time SHOW PROFILE is diiferent from SHOW PROFILES
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
It depends:
But the most important thing I see missing here is your task count, which means the amount of parallel processing (and since yours is Kafka, it means parallel consumers). Increase it and make sure your Druid host (or your middle manager host if it is a cluster) has the adequate cores for your tasks. And make sure in your middle-manager you have increased the total number of available tasks:
druid.worker.capacity