Home Forums HDP on Linux – Installation Mixed hardware install

This topic contains 4 replies, has 2 voices, and was last updated by  Feng Meng 10 months ago.

  • Creator
    Topic
  • #46981

    Feng Meng
    Participant

    Hi, can we use mix machines with different hardware specification to setup YARN e.g. one node with 12 core and 256G memory and another node with 16 core and 512G memory?

Viewing 4 replies - 1 through 4 (of 4 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #47241

    Feng Meng
    Participant

    Thanks Dave. The spec I give you is just an example. We do have a small number of very powerful machines to start with, but we’d like to eventually scale out by adding more less powerful ones. It is good to know at least this can be done.

    Collapse
    #47163

    Dave
    Moderator

    Hi Feng,

    There can be a decrease in expected performance due to the amount of slots differing over nodes.
    As this is only going to be a 2 node cluster, I expect it is going to be a dev / pre-prod?

    Thanks

    Dave

    Collapse
    #47155

    Feng Meng
    Participant

    I see. What’s on some downside of mixed hardware?

    Collapse
    #47019

    Dave
    Moderator

    Hi Feng,

    We recommend that all nodes in your cluster are of the same hardware specification.

    Thanks

    Dave

    Collapse
Viewing 4 replies - 1 through 4 (of 4 total)