Hi Vitezslav, Are you planning on migrating to HDP 2.0 ? Regards, Robert ...
Are you planning on migrating to HDP 2.0 ?
we will face the great task such as migration from hadoop 0.21 to hadoop 2.0. We have 7 servers (1x namenode, 6x datanode). We don’t dare to only upgrade hadoop 0.21 to 2.0. We want to migrate data gradually from one hadoop instance to another.
Internally we have some java applications, which connect to Hadoop via Hadoop Java libraries 0.21. But if we want to connect to both hadoop instances we would use two different library versions in one project. But this is not acceptable.
We considered about using webhdfs for second instance of hadoop, to avoid usage 2 different libraries. But we use hadoop archives, which cannot be accessible via webhdfs.
1. Is there any possibility to write java application accessing to 2 different versions of hadoop?
1.1. Could we connect to both hadoop instances with same java libraries (0.21)?
2. Is there any other way to avoid problem with a lot of small files, than using hadoop archives? (we have something about 120 million images)
Thanks for the reply
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world