MRUnit for Parquet

142 Views Asked by At

I am trying to test my driver with MRUnit and my MapDriver format is MapDriver <LongWritable, Group, ImmutableBytesWritable, KeyValue> I have found the correct serialization for KeyValue but cannot find one for Group and I get the following error.

    Group group = sfg.newGroup()
    parquetMapDriver.withInput(new LongWritable(), group);

No applicable class implementing Serialization in conf at io.serializations: class org.apache.parquet.example.data.simple.SimpleGroup

I am currently setting io.serializations like so

    parquetMapDriver = MapDriver.newMapDriver(parquetMapper);
    conf = parquetMapDriver.getConfiguration();
    conf.setStrings("io.serializations", conf.get("io.serializations"),
    MutationSerialization.class.getName(),
    KeyValueSerialization.class.getName(),
    WritableSerialization.class.getName(),
    ResultSerialization.class.getName());

Where I can find the serialization for Hadoop's Group Class?

0

There are 0 best solutions below