Home Forums Falcon disctp cant talk to target cluster

This topic contains 1 reply, has 2 voices, and was last updated by   1 month ago.

  • Creator
    Topic
  • #58192

    Cameron Walker
    Participant

    We’re looking at backup methods for our hadoop. We found out quickly that disctp will not work to copy data between our clusters because the Name nodes have been configured on networks that are private to each cluster. Therefore the datanodes from our primary cluster can not talk to the namenodes on the target cluster.

    However, our edge nodes for our two clusters have been configured so that they can, in fact, talk to both private networks. The network designers have placed nice 1G pipes on the edgenode hosts for the purpose of allowing the edge nodes to move data in and out of the clusters.

    The network team is of the opinion that Falcon can extract data from the datanodes in cluster through the single edgenode and transfer the data to the target cluster. My understanding is that Falcon is built on top of distcp and, if distcp can’t move the data, then Falcon can’t move the data.

    Who is correct? Can Falcon funnel all the data in a transfer through a single edge node like they believe? [ I realize that, even if possible, it presents a bottleneck but that's a different issue right now; the question is can it be done?]

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #64129


    Participant

    Vous pouvez facilement trouver vrais Moncler pas chère à prix réduits. Moncler? Doudoune Femme jolie et colorée,http://www.rhumatologie-grenoble.com/moncler.asp – Doudoune Moncler Pas Che boutique Moncler d’avoir une réputation de longue date. 2013 Veste Doudoune Moncler Femmes & Homme Pas Cher en ligne vente.,Acheter Amende UGG Pas Cher à Bas Prix Et Un Service Remarquable à La Bottes UGG Enhttp://www.corevihouest.org/uggs.asp – bottes pas cher Ligne Avec La Livraison Rapide Dans Le Monde Entie.,Acheter Amende UGG Pas Cher à Bas Prix Et Un Service Remarquable à La Bottes UGG Enhttp://www.corevihouest.org/uggs.asp – ugg pas chere Ligne Avec La Livraison Rapide Dans Le Monde Entie.,Vous pouvez facilement trouver vrais Moncler pas chère à prix réduits. Moncler? Doudoune Femme jolie et colorée,http://www.rhumatologie-grenoble.com/moncler.asp – Doudoune Moncler boutique Moncler d’avoir une réputation de longue date. 2013 Veste Doudoune Moncler Femmes & Homme Pas Cher en ligne vente.

    Collapse
Viewing 1 replies (of 1 total)