According to Matsuura, “We set up the proof of concept, loaded various data on Hadoop, and verified operations and results to gradually build up our knowledge.”
After several years of knowledge building, SoftBank was convinced of the potential of Hadoop and at the same time, opportunities for big data utilization in business also increased. Thus, in 2015, a Hadoop environment of a larger scale was built in SoftBank as a company-wide project. Hortonworks’ HDP was selected as the Hadoop distribution.
According to Matsuura, “Our technical skills have improved over the years in the development and operation of the Hadoop environment. On the other hand, with limited understanding of all the source codes, we were unable to judge whether the environment we created was optimized or not. That was why we decided to engage the expert services of an experienced distribution partner to validate and value-add to our implementation.”
Kato also expressed his satisfaction with Hortonworks’ components and support. “Hortonworks has a lot of experience as a pioneer in this area, and we really appreciate their support. When using open source software, it is quite common to encounter operation problems such as poor performance or absent data, but with Hortonworks’ support, our operation is very stable. I’m very satisfied with the quality they have delivered. Their engineers are very skilled and experienced.”