Is JobTracker a single point of failure too (besides NameNode) in Hadoop?

Ask Time：2014-05-02T14:11:12 Author：user2938723

I am new to Hadoop. In hadoop, I know that when a NameNode fails the entire Hadoop framework goes down. So it's a single point of failure in Hadoop. Is it same for JobTracker? Because if the JobTracker goes down, there would be no daemon to contact Namenode after a job submission and also no point for running the TaskTrackers. How is this handled exactly?

Author:user2938723，eproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article：https://stackoverflow.com/questions/23421890/is-jobtracker-a-single-point-of-failure-too-besides-namenode-in-hadoop

Andrey Sozykin :

Yes, JobTracker is a single point of failure in MRv1. In case of JobTracker failure all running jobs are halted (http://wiki.apache.org/hadoop/JobTracker).\n\nIn YARN, Resource manager is not a single point of failure.\n\nIf you need MRv1, you can use MapR distribution, which provides the JobTracker high availability (http://www.mapr.com/resources/videos/demo-hadoop-jobtracker-failing-and-recovering-mapr-cluster). ",

2014-05-02T07:11:52

SachinJose :

Jobtracker HA(High Availability using Active and Standby) can be configured in Cloudera Hadoop distribution. See the following link, this feature is available from CDH4.2.1 onwards:\n\nhttp://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-High-Availability-Guide/cdh4hag_topic_3_1.html\n\nThe same can be configured in Hortwonworks distribution also \nhttp://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.3.2/bk_hdp1-system-admin-guide/content/sysadminguides_ha_chap2_5_5.html\n\nIn MR2 master service is ResourceManager, which is not Single Point of Failure",

2014-05-02T08:57:44

Is JobTracker a single point of failure too (besides NameNode) in Hadoop?