How to zip CSV file ? Azure Data Lake / Databricks

445 Views Asked by inspiredd At 03 April 2025 at 21:20

I have a CSV file in Azure Data Lake. I'd like to change type for this file to csv.gz by DataBricks.

I can write this file to df, then save file as csv.gz and then remove csv file from data lake.

Is it possible to change type to csv.gz without writing file to df?

Thanks in advance.

There are 1 best solutions below

Cindy Pau On 29 September 2020 at 03:12

Is it possible to change type to csv.gz without writing file to df?

No, it is not possible. Write this file to df, then save file as csv.gz and then remove csv file from data lake is the right way.