Home Forums YARN hadoop yarn resource management

This topic contains 0 replies, has 1 voice, and was last updated by  Vijay R 8 months, 2 weeks ago.

  • Creator
    Topic
  • #51264

    Vijay R
    Participant

    I have a Hadoop cluster with 10 nodes. Out of the 10 nodes, on 3 of them, HBase is deployed. There are two applications sharing the cluster. Application 1 writes and reads data from hadoop HDFs. Application 2 stores data into HBase. Is there a way in yarn to ensure that hadoop M/R jobs launched by application 1 do not use the slots on Hbase nodes? I want only the Hbase M/R jobs launched by application 2 to use the HBase nodes. This is needed to ensure enough resources are available for application 2 so that the HBase scans are very fast.

    Any suggestions on how to achieve this?

You must be logged in to reply to this topic.