I have a distributed program, for example, it has ten process, and all of them will execute some job, all job info will storage to a same MySQL database. At a same moment, there was a lot of running job in database, and they are belong to different process. When one process crash, how can I recovery it running job info in a new process. By the way, my enviroment has MySQL and zookeeper.
In a distributed program, how to recovey its corresponding data when a process crashes
51 Views Asked by hehe At
1
There are 1 best solutions below
Related Questions in ARCHITECTURE
- Where to store secret token for an embeddable web widget?
- Separation of Students and Users in NestJS Microservice architecture
- What's the right ZMQ architecture for my scenario?
- Javers in microservice architecture
- How to prevent users from creating custom client apps?
- How to manage different repositories for different clients with the same project?
- Adding users file storage feature to my application
- Transform Load pipeline for a logs system: Apache Airflow or Kafka Connect?
- Shoulld I decode JWT only on auth server?
- How to stored last ~1500 events in Sorted Set in Redis
- Should data be standardized on the backend or the client (front-end, mobile app)?
- Can I treat CNN channels separately to make placement predictions?
- How to handle sync distributed transaction in microservices?
- Database design, authentication and authorization in a microservices ticketing system
- Is there any example or design of a queue system in microservices?
Related Questions in DISTRIBUTED-SYSTEM
- How to avoid duplicates with the pull-based subscribe model?
- Micrometer & Prometheus with Java subprocesses that can't expose HTTP
- SQL connection throws error when adding DistributedSession, SessionMiddleware
- How to use NFS locks or any other mechanism to keep data in sync on multiple mountpoints
- The two data nodes return different results
- How to run an MPI program across multiple docker containers without manually ssh'ing
- How do I parallelize writing a list of Pyspark dataframes across all worker nodes?
- Does AWS use distributed systems?
- How to version control a source code which communicates with database?
- Searching for succ(p+1) in Chord systems
- How to design a long running process that can continue after an outtage?
- akka.cluster.ddata.Replicator$Internal$DeltaPropagation message from clusterReceptionist replicator is dropped because it exceeds the size limit
- In the storage-computing separation deployment mode, why does one of the three nodes have no disk space?
- Out-of-order AppendEntries in Raft
- Automatic Load Balancer with Locust 2.20.0 on Windows - High Ping and Scaling Challenges
Related Questions in DATA-CONSISTENCY
- How to build a tightly consistent item assortment table with pagination, sort, filter and search?
- Handling inconsistency in a highly normalized DB with long load times
- How to compute MD5 on the http server while providing file download
- How to check data integrity/consistency in asynchronous (event-driven) system
- How to avoid thread interference while updating database in multithreading
- DolphinDB - Verify data consistency during database migration
- How to manage Data consistency between two microservices?
- Spring Data: How to maintain cache consistency in transactional methods?
- The relationship between Paxos family and data consistency
- Data consistency in DAOs
- Data Consistency check in ADF Copy activity with Source as Query on Teradata Table and Sink as CSV in Azure Blob
- Flutter List after storing all data in a for-loop, when out of loop replace all stored records with the last record. Why's that?
- Data consistency around instances of same micro service
- How to share data between microservices without sync RPC (use topics as changelogs) and deal with consistency?
- How to ensure DNS records consistency between primary DNS servers?
Related Questions in CRASH-RECOVERY
- In a distributed program, how to recovey its corresponding data when a process crashes
- How do I check rebuild is complete after losing a replica?
- Electron recovery after crash on render process
- Could anyone explain why is Write-Ahead Log the use NO-FORCE?
- How to know if a MapReduce job has restarted or is a fresh start?
- Is it possible to verify data of multiple sequential writes just by checking the last n bytes written?
- How to call ENDCMTCTL with pending changes?
- Why we should not have the collective size of innodb_log_files more than the size of the innodb_buffer_pool
- Notepad++ fixing after a crash, interpreting the .dmp interpretation
- Building a crash tolerant serial number generator via log files
- Good Architecture/Library For Robust Plugin/Addon Management
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
You should set an ID to every running process You should set an ID to every running job You should put code process in try...catch...finally , to know which ID trashed You should manage relations between process ID and its IDs jobs