I have a big gzip file (11GB) and I want to print as fast as possible the line that I want with Python. I have tried to do it with linecache.getline(), but as the own function open the file, you are not able to open it with gzip.
How to read a specific line from a gzip file with python
805 Views Asked by Sergi Aguiló At
1
There are 1 best solutions below
Related Questions in PYTHON
- How to store a date/time in sqlite (or something similar to a date)
- Instagrapi recently showing HTTPError and UnknownError
- How to Retrieve Data from an MySQL Database and Display it in a GUI?
- How to create a regular expression to partition a string that terminates in either ": 45" or ",", without the ": "
- Python Geopandas unable to convert latitude longitude to points
- Influence of Unused FFN on Model Accuracy in PyTorch
- Seeking Python Libraries for Removing Extraneous Characters and Spaces in Text
- Writes to child subprocess.Popen.stdin don't work from within process group?
- Conda has two different python binarys (python and python3) with the same version for a single environment. Why?
- Problem with add new attribute in table with BOTO3 on python
- Can't install packages in python conda environment
- Setting diagonal of a matrix to zero
- List of numbers converted to list of strings to iterate over it. But receiving TypeError messages
- Basic Python Question: Shortening If Statements
- Python and regex, can't understand why some words are left out of the match
Related Questions in GZIP
- How to create an improperly closed gzip file using python?
- HTTP/2 POST requests with compressed responses failing ERR_HTTP2_PROTOCOL_ERROR 200 (OK)
- Compress gzip/Deflate string with golang
- Missing System.IO.Compression.Native.dll in .NET 8 leads to error when using GZipStream
- How to decompress the contents of a var to another var?
- Why response body not compressed when use webtestclient?
- incorrect header check while implementing GZIP in spring boot REST APIs
- Extract gz files within gz files in Python
- aws s3 cp emr stdout.gz file as txt encoding issue
- .gz archive have the content-type identified wrong?
- Error in reading .gz file in python using gzip
- Error BadGzipFile when read gz file via python gzip
- zcat or gzip -dc taking more time while searching the string in 48364 files
- Kotlin Gzip String not working as expected
- Is the DEFLATE compression algorithm in ZIP and GZip formats based on LZ77 or LZSS?
Related Questions in READLINE
- Bun.js: Read a single line user input
- Trying to echo line variable along with another variable inside a while read loop
- QuartoDocument input
- Having an asynchronous issue with my JavaScript code when using a timeout with Node.js
- How can I read more than 4096 bytes from stdin, copy-pasted to a terminal on Linux?
- Edit the final part of large(1.5gb) text file in NodeJS
- text file -- how to sort adjacent lines that have the same level of indentation
- Why do my Java server tests pass when I add a System.out.println(in.readLine()) statement before the tests, but fail without that statement?
- How can I get rid of seeing escape characters in Python3.12?
- Accessing Readline's "application name" in Ruby
- Reprint readline question after user input
- How to let the readline() function run correctly within r markdown document, and keep messaging on screen functiona?
- Make readline tab cycle options within a C application
- Python readline() bug, writes at eof
- Use ansi escape sequences to create a border between input and output
Related Questions in LINECACHE
- How can I check if there is a Specific Word in a fileline?
- Read GB2312 encoding file with linecache.getline
- Python - getline() method not printing "newlines"
- `inspect.getsource` from a function defined in a string? `s="def f(): return 5"`
- Skipping first line of a file when using linecache
- Python: linecache file size limit?
- Replacing numbers in a list of lists with corresponding lines from a text file
- How to read a specific line from a gzip file with python
- Linecache in python is not caching the lines specified
- select specific lines with specific condition from a large text file with python
- Why does linecache check for the length of the tuple elements in the cache?
- linecache doesn't work in an if statement?
- Linecache getline does not work after my application was installed
- Error in reading a file using line number in python
- Comparing 2 variables when one is retrieved from text file
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
linecacheexpects to get a textfile. A file that has been compressed usinggzipis not a textfile. To do what you want requires two steps. (1) Unzip the file so that you have a textfile. (2) Uselinecacheon the textfile. You can do both of those things in Python, but only one after the other.I understand that you want to get at a specific line without having to decompress then entire zipfile. But that is not how zipfile compression works. There is unlikely to be anything in the compressed data that corresponds to the notion of a line of text.