Writing a Parquet.Net file using RLE_DICTIONARY encoding

765 Views Asked by At

The Parquet.Net specification says I can read and write in RLE_DICTIONARY encoding. I am trying to read the docs of Parquet.Net and the github repo code, but how do I write my DataTable to use this encoding?

The demo I am basing this off of is found here:

Stack Overflow Parquet Size Discrepancy Question

1

There are 1 best solutions below

1
On

I'm finding this answer either, I just found an answer like this: if you are using spark just write DataFrame with

df.write
.option("parquet.enable.dictionary",true) //true is RLE_DICTIONARY and false plain (maybe)
.parquet(yourPath)