Does HBase MapReduce support a combiner stage? And if so, how?

665 Views Asked by At

Hadoop map reduce supports a combiner stage. However, I can't find a similar capability in the HBase MapReduce package. Does it exist?

2

There are 2 best solutions below

0
On BEST ANSWER

If you are running a MapReduce job with HBase as an input format and non-hbase output formats it is the same.

A combiner is a reducer that only operates on the output of a single mapper. As long as you only do things that are idempotent in your reducer, than you can put your reducer in the combiner slot by simply saying: job.setCombiner(.class);

0
On

You can use job.setCombiner(.class); method to use combiner class in map reduce. Reducer will aslso acts as an combiner