I'm using the xz zipping utility on a PBS cluster; I've just realised that the time I've allowed for my zipping jobs won't be long enough, and so would like to restart them (and then, presumably, I'll need to include the .xz that has already been created in the new archive file?). Is it safe to kill the jobs, or is this likely to corrupt the .xz files that have already been created?
1
There are 1 best solutions below
Related Questions in UNIX
- passing text with \n as one argument in shell
- C std library don't appear to be linked in object file
- How to split a directory into parts without compressing or archiving?
- Momentjs get current GMT unix time
- Timing packets on a traffic server
- man pages for c variable types
- Blocking in pthread_join()
- PWX-00001 Error opening repository "dtlmsg.txt". RCs = 268/150/2
- Unix c program to calculate pi using threads
- How to perform parallel processes for different groups in a folder?
- Set aliases globally for all users
- wmic csproduct get UUID equivalent for Unix and Mac?
- Send alert for 80% threshold comparing two values from Disk partition
- Unix - Tail Utility would open the file or not
- Redirect Outward of unix os commands to html page
Related Questions in PBS
- pbs python Error: No module named _pbs
- How does PBS_NODEFILE work in pbs?
- Messaging between torque jobs in a cluster
- PBS/TORQUE: how do I submit a parallel job on multiple nodes?
- Scripting parallel iterative deconvolution with many time points on a large cluster using ImageJ
- how to run PBS (portable batch system) with multiple user environment?
- What is the syntax of PBS job limit directive
- Output file contains nothing before script finishing
- Can I change a the PBS script file of a job that is on hold in TORQUE Resource Manager?
- Why does pbs(dsh) schedule my task onto one node?
- Wait for set of qsub jobs to complete before next command
- How can I read the PBS launch script of a job that is running?
- Syntax error in executable pbs script
- Send array to pbs script
- Capturing performance of a cluster
Related Questions in XZ
- update packages on red hat without internet connection
- Is .xz file format description telling it all?
- Killing a Unix zipping process
- How to add ZipEntry using XZ for Java
- How can i read xz file without decompressing in c++?
- Extracting tar.xz won't output file PHP
- "liblzma library and headers are required" when installing R-4.2.2 and dependencies under $HOME
- Read .xz file from S3 in C#
- Decompressing or Extracting the XZ Frida Server?
- Compressing Directory tree into multiple tar archives into a single xz
- Rsync with .dd.xz files
- PSQL Restore db file with xz
- Error when trying to read an .xz file in R with readr functions
- How can I compress many files in a solid archive, but quickly extract only one?
- How to set default params for xz archiver?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
I am not sure about the implications of using
xzin a cluster, but in general killing anxzprocess (or any decent compression utility) should only affect the file being compressed at the time the process terminates. More specifically:Any output files from input files that have already been compressed should not be affected. The resulting
.xzcompressed files should remain perfectly usable.Any input files that have not been processed yet should not be altered at all.
The input file that was being compressed at the time of termination should not be affected.
Provided that the process is terminated using the
SIGTERMsignal, rather than a signal than cannot be caught likeSIGKILL,xzshould clean-up after itself before exiting. More specifically, it should not leave any partial output files around.If
xzis killed violently, the worst that should (as opposed to might) happen is for a partial compressed file to remain on the disk, right along its corresponding input file. You may want to ensure that such files are cleaned up properly - a good way is to havexzwork in a separate directory from the actual storage area and move files in and out for compression.That said, depending on the importance of the compressed data, you may still want to incorporate measures to detect and deal with any corrupt files. There can be a lot of pathological situations where things do not happen as they are supposed to...