Getting Hadoop cluster and Job Statistics

451 Views Asked by At

Is there any way I can get the detailed statistics of different jobs that are alive(running), submitted, failed on my cluster? Also I want to get the slots utilization per job and resource utilization per queue.
Hadoop ResourceManager's Web Console already does this but I want some Tool(with better representation) or some java libraries which can derive the same.

1

There are 1 best solutions below

2
On

Try http://host:port/jmx to get response of the JMX (of corresponding resource) in JSON format.

If you want job related statistics use: http://:50030/jmx (in Hadoop 1, I am not sure about Hadoop 2).