Deployments at Yahoo!
The meetup kicked off with YARN committers from Yahoo presenting on current Hadoop 2.0 deployments at Yahoo. As part of the presentation, the following were covered.
- described scenarios where YARN positively advanced the state of the art like scalability, its current stability, the power of the YARN web-services, and its superlative performance compared to the previous versions.
- efforts undergone relation to battle testing YARN including application validation and performance benchmarking.
- summed it up with suggestions for improvements to issues like UI loading, lack of generic history server etc.
Chris Riccomini’s on “Building Applications on YARN”