Mappers which are reading the Hbase table's regions are not running local
We are having MR job which reads the Table’s data, after performing some operations commits the data back.
We are having two regions servers and The table is having 20milion records on two Machines in 15 regions ( 8 regions on Machine1 and 7 regions on Machine2).
When we run the MR job,Some Mappers on Machine1 are reading the regions on Machine2. This is causing the MR job to take hours of time to complete.
The mappers are reading like this every time.
Can someone help us on this.
Support from the Experts
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Become HDP Certified
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world