Home:ALL Converter>Namenode and Jobtracker information on Hadoop cluster

Namenode and Jobtracker information on Hadoop cluster

Ask Time:2016-07-24T11:02:37         Author:Arvind Kumar

Json Formatter

How can i get the following information on the Hadoop Cluster ? 1. namenode and jobtracker name 2. list of all nodes with their roles on the cluster

Author:Arvind Kumar,eproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/38548342/namenode-and-jobtracker-information-on-hadoop-cluster
Alex Raj Kaliamoorthy :

I am using cloudera based cluster and also working on EMR.\nIn both the clusters I can find the information from the configuration dir.\nTo get the namenode information go into core-site.xml file and look for the fs.defaultFS as @daemon12 said\n\nHere is the straight way to get it.\nFor namenode information use the below command\ncat /etc/hadoop/conf/core-site.xml | grep '8020'\n\nHere is the result\n\n<value>hdfs://10.872.22.1:8020</value>\nThe values inside the value tag is the name node information.\n\nSimilarly to get the jobtracker information do the below\n\ncat /etc/hadoop/conf/yarn-site.xml | grep '8032'\n\nHere is the result\n\n<value>10.872.12.32:8032</value>\n\nAgain the jobtracker value is inside the value tag.\n\nGenerally the NN and JT information is used to run the Oozie jobs and this method will help you for that purpose.\n\nDISCLAIMER: I am grepping the result of cat based on the namenode and jobtracker port number which is 8020 and 8032 respectively. This is widely known ports for NN and JT in Hadoop. If your organization uses a different one, please use that to get more appropriate result.",
2018-01-31T14:54:59
PradeepKumbhar :

Along with the command-line way of getting information, you can get the similar information in the browser also:\n\nhttp://<namenode>:50070 (For in general hadoop informtion)\nhttp://<namenode>:50030 (For JobTracker related information)\n\n\nThese are default ports. You can check here for more information.",
2016-07-25T05:31:52
Sagar Morakhia :

To get namenode info:\n\n hdfs getconf -confKey fs.defaultFS \n\n\nFor jobtracker\n\n hdfs getconf -confKey yarn.resourcemanager.address.rm2\n",
2018-03-29T16:08:38
yy