What does it take to get a Hadoop cluster from a couple hundred nodes to a couple thousand? This talk will cover some of the major considerations when scaling up a big data deployment – systems architecture, networking, application and data layout designs and operational best practices. A lot of time will be reserved for Q&A.
Speaker: Aaron Wiebe, Director of Site Reliability Engineering @ Hortonworks
Aaron has worked in the big data space for nearly 8 years, starting his journey at BlackBerry where he led the deployment of Hadoop and supporting services on more than 4000 machines and 50PB total deployed capacity. Since joining Hortonworks in 2013, he has worked with the largest Hadoop and Big Data deployments in the world.