When I try importing the mastar-goodspec-v3_1_1-v1_7_7.fits file (about 7 GB) on a Jupyter notebook, I get a warning saying that only x GB were imported. Unsurprisingly, when I try to do anything this data, I recieve a "unsufficient buffer size" error, which is frequent with corrupted files.
I have read that FITS files were not adequate for large file sizes and that I should convert it to another format such as HDF. I tried doing this inside the Jupyter notebook, as well as on cmd with a module called fits2hdf - To no avail in both cases, as the file was already truncated as I was converting it.
In my documents, the file does contain 7 GB so the original download is not to blame.
I would like to be recommended a way to stop the file from being truncated. I do not need all 7GB worth of rows in this file, so if it's possible to reduce its number of rows before importing it to Jupyter, that would work for me too.