Writing MapReduce and YARN application together

105 Views Asked by At

I want to run MapReduce application using Hadoop 2.6.5 (in my own native cluster) and I want to update some things in YARN thus I have seen that I can write my own YARN application (https://hadoop.apache.org/docs/r2.6.5/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html). But it seems like if I am running YARN in this way (with YARN client) then, I can't use the MapReduce paradigm (Map and Reduce Function) with a Job class.

Is there any option to write my own ApplicationManager and using the MapReduce paradigm with the simple Job class?

These are some useful examples I have found regarding writing YARN application https://github.com/noitcudni/yarn https://github.com/hortonworks/simple-yarn-app https://github.com/blrunner/yarn-beginners-examples/blob/master/src/main/java/com/wikibooks/hadoop/yarn/examples/MyClient.java

*Using Spring or Twill will result in the same problem.

0

There are 0 best solutions below