Is there a possibility to run Spring Cloud Data Flow in cluster mode ? I have many apps running on SCDF, I wanted to ensure that SCDF is always up and running just like a kafka cluster.
Running Spring Cloud Data Flow in Cluster mode
211 Views Asked by Jibit George At
1
There are 1 best solutions below
Related Questions in SPRING
- Redirect inside java interceptor
- Spring RestTemplate passing the type of the response
- spring-integration-dsl-groovy-http return null when i use httpGet method
- Custom Spring annotation for request parameters
- Spring - configure Jboss Intros for xml with java config?
- HTTP Status 404 - Not Found in Spring 3.2.7
- AndroidAnnotations how to use setBearerAuth
- android I/O error: java.security.cert.CertPathValidatorException: Trust anchor for certification path not found
- Show login dialog when not authenticated yet
- Spring Data Rest supporting json and xml
- @Value annotation not resolved in a class that belongs to dependency jar
- Remove nested _embedded fields while using projections
- How to send Rest GET request that contains "#" value in url parameters?
- How to inject spring bean into Validator(hibernate)
- How to keep a variable in the URL when using Spring LocaleChangeInterceptor
Related Questions in SPRING-BOOT
- Timing Issue with Spring Boot Annotation Configuration
- LightAdmin - Customise parsing DateTime with app timezone
- Creating distribution with repackaged spring boot jar using gradle application plugin
- Spring Boot MVC non-role based security
- Add JVM args to spring boot application
- The method and() is undefined for the type HttpSecurity
- swagger ui not working for swagger version 2
- Spring IO Platform 2.0 - Themes/Changes?
- JPA findDistinctPropertyBy magic method doesn't work as expected when using spring-boot-starter-jpa
- Spring boot check external service status on boot
- Running a specific spring batch job amongst several jobs contained withing a spring boot fat jar
- Adding security to rest api service built with Spring Boot app
- Spring Redirecting from Http to Https Breaks Rest Controller Test
- Service not starting using Spring-boot during integration tests
- Spring Boot Actuator Health Returning DOWN
Related Questions in APACHE-KAFKA
- Spark streaming + kafka throughput
- How to diagnose Kafka topics failing globally to be found
- kafka: what do 'soTimeout', 'bufferSize' and 'minBytes' mean for SimpleConsumer?
- Fail to create SparkContext
- Syntax error on tokens, delete these tokens - kafka spring integration demo application
- How could Kafka 0.8.2.1 with offsets.storage=kafka still require ZooKeeper?
- Message Queues: Per Message Guarantees
- How should a Kafka HLC figure out the # of partitions for a topic?
- Kafka multiple consumers for a partition
- Should Apache Kafka and Hadoop be installed seperatedly (on a diffrent cluster)?
- how does one combine kafka-node producer and node tail?
- How to fix NoClassDefFoundError with custom Kafka producer under Eclipse?
- Apache Samza's CheckpointTool won't give away partition offsets
- Offsets for Kafka Direct Approach in Spark 1.3.1
- Simulate kafka broker failures in multi node kafka cluster and what operations and tools to use to mitigate data loss issues
Related Questions in SPRING-CLOUD-DATAFLOW
- Does Spring Cloud Dataflow Local Server need to connect zookeeper?
- Spring Cloud DataFlow - How to use a custom TCP encoder/decoder in TCP source
- Advantage of using Spring cloud data flow instead of spring batch
- PCFDev Spring Cloud Data Server app import failes
- How to build Spring Cloud Stream JMS ActiveMQ
- Understanding Spring Cloud Stream content types
- Migrating from spring-batch-admin to spring cloud dataflow
- Spring Cloud Stream header enricher circular reference and NPE
- Spring Cloud Dataflow server - deployed streams ended up in unknown state
- spring-data-flow task example
- Dynamically change a Source parameters
- Scheduling a composed task
- cloud foundry spring cloud data flow server security configuration
- Redis Connection failure exception received when trying to run Spring-cloud-data-flow server in docker container
- spring cloud data flow server cloud foundry redirect to https
Related Questions in KAFKA-CLUSTER
- Kafka-Connect : Getting an unrecognised error when starting a S3 Sink Connector
- Springboot kafka streams Application failed if one kafka broker went down
- Running Spring Cloud Data Flow in Cluster mode
- AZ deploy ARM template returns exceptions
- Kafka: What is the minimum number of brokers required for high availability?
- Two (Kafka) S3 Connectors not working simultaneously
- Local kafka cluster "__consumer_offsets" leader not available
- Can't write data to kafka cluster
- Is it possible to lose Consumer group Offsets by Kafka brokers?
- Not able to read messages from kafka consumer in kafka cluster setup
- What happens when min.compaction.lag.ms is greater than log.cleaner.max.compaction.lag.ms?
- Kafka cluster does not work if broker with ID=0 is down
- How to make a multi-regional Kafka/Zookeeper cluster using multiple Google Kubernetes Engine (GKE) clusters?
- Kafka Cluster sometimes returns no records during seek and poll
- Mirrored repartition topics keep increasing in size
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
As far as you have multiple instances of SCDF applications, you can plug an LB in front to mediate the traffic. That's a common practice.
That said, though, SCDF itself doesn't get huge traffic from requests/responses per see. The traffic really only occurs when you are using the SCDF Dashboard or exercising the SCDF APIs. Even for any reason, the SCDF App crashes, the platform (eg: K8s) where it runs will bring it back up in <20secs. SCDF is a Boot App, and roughly this much time it takes to start - in the future, there'll be a Graal Native compiled version of SCDF, which would dramatically reduce the startup time.
Given the above explanation, you won't have a noticeable downtime. This is one of the reasons to run SCDF in container orchestration platforms like Kubernetes, so you can leverage the platform's resiliency functionality.