Home Forums MapReduce NameNode as datanode (error)

This topic contains 0 replies, has 1 voice, and was last updated by  David Hall 1 month, 3 weeks ago.

  • Creator
    Topic
  • #55441

    David Hall
    Participant

    I’ve got a situation where the namenode is being used as a datanode and mappers are being run there. Not good. For some reason I HoClient.getActiveTrackerNames() is returning the Namenode as well as all datanodes. What configuration mess up could cause this?

    I’m trying to get Sqoop to run my mappers, exactly one per Datanode. I’ve written my InputFormat class to create splits with exactly one hostname (datanodes only) per split, yet am being ignored. Why is the Jobtracker ignoring my splits? The host names I’m submitting are exactly as getActiveTrackerNames() returns, sans the :nnnnn, as suggested in getActiveServersList() by Boris Lublinsky and Mike Segel. btw: this system works in that other Hadoop environment. This is an Amazon hosted system.

You must be logged in to reply to this topic.