Thanks for the update Vivek. Jason, yes, MAPREDUCE-5351 exists in HDP 1.3.0 and shipped in HDP 1.3.2 -Koelli ...
Thanks for the update Vivek.
Jason, yes, MAPREDUCE-5351 exists in HDP 1.3.0 and shipped in HDP 1.3.2
We are using HDP 1.3, and JT is Version: 18.104.22.168.3.0.0-107.
We are seeing a steady growth of the JobTracker heap , and finally it hits Java heap space error.
The below are the cluster specs;
Nodes – 4
Map Tasks – 32
Reduce Tasks – 12
Job Submissions a day = 2000 (around 100 jobs out of this runs with 250+ maps tasks)
Job Tracker heap = 2G
With some good amount of jobs,the JT is lasting hardly for 3-4 days.
Looking at the heap, there are like many instances ~8K of DFSClient which gets me suspicous.
Any help appreciated.
The topic ‘HDP 1.3 JobTracker hitting Out of Memory’ is closed to new replies.