Recently, I read the GFS paper but I have some trouble on the data strcuture of the checkpoint. So what does Checkpoint's data structure look like, and how is it designed
The structure of the GFS checkpoint
309 Views Asked by YoungLH At
1
There are 1 best solutions below
Related Questions in B-TREE
- B-Tree deletion in a single pass
- Implementing Tree Structure in disk memory
- creating a binary tree and BST using (linked list) python
- Deleting a node in a B-Tree - using inorder Predecessor vs. Successor as the replacement key
- using B tree index with like operator
- Delete method for 2-3 btree segmentation fault
- How to implement B+ tree in Haskell?
- Postgresql BTREE index row size limitation
- Finding the height of the B-Tree of a table in SQL-Developer
- Calculating the Blocking Factor for a B+ Tree leaf node
- Storing a large number of objects that belong to a list
- List sorted on key1, random access on key2
- btree in btree with mysql or postgres
- Optimal on-disk data structure for searching a file?
- comparing databases and their locks
Related Questions in CHECKPOINT
- Spark RDD checkpoint on persisted/cached RDDs are performing the DAG twice
- Tensorflow: loss resets after successfully restored checkpoint
- How to change MySQL checkpoint interval
- My checkpoint albert files does not change when training
- Apache Flink to use S3 for backend state and checkpoints
- How do I make a base64 .p12 usable?
- Flink checkpoints size are growing over 20GB and checkpoints time take over 1 minute
- Creating Checkpoints in XNA
- Live Wireshark Capture with ssh-key on Checkpoint Firewalls
- How to continue training DETR model from last epoch using checkpoints?
- Getting error KeyError: 'model_state_dict' on loading the finetuned ResNet pretrained model
- The size of checkpoint gets larger and larger without using state in tumblingProcessingTimeWindows
- Rerunning the iterations from a saved checkpoint in Tensorflow
- How to pull Check Point Logs from a Check Point Device
- Checkpointing (snapshot/resume) library on Windows?
Related Questions in GFS
- What is the similar function to Distributed cache of Hadoop Distribution File system in Google File System
- Why Google File System divide files into Chunks with 64 MB？
- Is there any abstraction layer to work with GFS or HDFS?
- What is atomicity in the context of filesystems?
- The structure of the GFS checkpoint
- Why Google File System divide files into Chunks？
- Is the HDFS sink in Flume using a "anti-pattern" with it's default config
- how is a chunk server different from normal server?
- Processing big data on distributed system
- Xarray mfdataset combining files with different variables using cfgrib engine
- How to open multiple files in a path skiiping files with a determined name
- Does the Google File System allow listing directory contents?
- GFS/Hadoop master's storage capacity
- Persistent Logging in Gnome-Shell-Extension development?
- Why doesn't Hadoop file system support random I/O?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
When the operation log reaches a certain size, the GFS master will do a checkpoint, which is equivalent to dumping the log data in the B-Tree format of the memory to the disk. Note that you can understand the checkpoint at this time as a process;
when the master needs to be restarted, you can read the most recent checkpoint, and then replay the operation log after it to speed up the recovery time. Note that you can understand the checkpoint at this time as a reference, which refers to the result data of the most recent process of the checkpoint.