CloudFront: HOW TO RUN MAPREDUCE PROGRAMS USING ECLIPSE

CloudFront: HOW TO RUN MAPREDUCE PROGRAMS USING ECLIPSE: Hadoop provides us a plugin for Eclipse that helps us to connect our Hadoop cluster to Eclipse. We can then run MapReduce jobs and browse Hd...

SharePoint Orange: How to : working with HBase Coprocessor

SharePoint Orange: How to : working with HBase Coprocessor: HBase Coprocessor : It allows user code to get executed at each region(for a table) in region server. Clients only get the final responses...

High available hadoop cluster

One of the problems which is being discussed with the Hadoop cluster was that is not high available due to the name node failure, as it single point of failure, so here is new version of  Hadoop that is coming with high avalibility option that is two  NameNode  , where the switching of  NameNode  will happen automatically as one  NameNode  goes down, the other will take charge meanwhile we can check the problem with the name node,

The proposed design follows:

So you can thin it of two cluster interconnected using switches and high speed communication line.

so mainly this will be dependent a service called heartbeat that will check the aliveness of NameNode if one goes down the redirection will be done automatically.

We can see the it as follow too: