Get fresh updates from Hortonworks by email

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.


Get Started


Ready to Get Started?

Download sandbox

How can we help you?

closeClose button
March 21, 2017
prev slideNext slide

Top 6 Reasons to Use Apache Hadoop, Apache Spark and Apache Hive in the Cloud | Hortonworks

We at Hortonworks have spent countless hours working with customers as they use Apache Hadoop, Spark and Hive in the cloud, to help them better leverage the cloud platforms they use for these data processing workloads. In the interest of community and sharing, wanted to share some of the “top reasons” we’ve heard. Enjoy!

Cloud computing enables new levels of business agility for IT, developers and data scientists, while providing a pay-as-you-go model with unlimited scale and no upfront hardware costs. Performing data processing on cloud platforms (for example, from Microsoft Azure and Amazon Web Services) is especially effective for ephemeral use cases where you want to spin up analytic jobs, get the results and then bring down the cluster so you can manage your costs.

        1.  Scale to your needs

Historically, as the analytics demand grew within enterprises, a need to expand the capacity of the Hadoop clusters emerged. Typically, the time required for hardware to become available could take days or weeks, limiting innovation and growth. Apache Hadoop, Spark and Hive in the cloud enables growth of data processing power in real time – just flip a switch and new machines come online & get to work. This creates an overall data processing solution that scales rapidly to meet growing business needs.

  1. 2. Reduce your costs for innovation

For companies getting started with Big Data analytics and processing in the cloud (such as Apache Hadoop, Apache Spark and Apache Hive) the low capacity investment, without the need for extensive Administration and without the upfront hardware costs, makes perfect sense. Businesses are already realizing the value of the cloud for quick, one-time use cases involving Big Data computation, allowing them to improve business agility and gain insight with near instant access to hardware and data processing resources.

  1. Pay for what you need

Undoubtedly, the cloud is beneficial for running ephemeral use cases where you want to spin up a job, get the results and shut things down (and stop the spending meter). Since the cloud is flexible and scales fast, you pay only for the compute and storage you use, when you use it.

  1. Use the right machine for the right job

Some data processing jobs require more compute resources, some require more memory, while others require a lot of I/O bandwidth. With the cloud, you can easily use the right machine for the right job. Cloud solutions offer a choice to the end user to provision clusters with different types of machines for different types of workloads. Intuitively, cloud provides a flexible solution for the problem of managing variable resource requirements.

  1. Draw insights from data where it naturally lives

As businesses start using more and more devices “on the edge”, the data generated from these devices starts living in the cloud. As analytics thrive on data (typically large volumes of it), it makes a lot of sense for the big data analytics  processing platform to exist in the cloud with the data.

  1. Simplify your operations

Using the cloud, one can provision different types of clusters with various characteristics and configurations, each suitable for a particular set of jobs. This frees the IT Administrators from having to manage multiple clusters or intricate policies for a multi-tenant environment.

Ready to Go?

To get started on with a free trial for Microsoft Azure HDInsight powered by Hortonworks Data Platform, go here. For more information, please refer to the following links.

Product Webpage
Azure HDInsight Tutorial
Forrester Wave Big Data Hadoop Cloud Solutions Report



To get started on Hortonworks Data Cloud for AWS, go here for a 5 day free trial using the AWS Marketplace listing. For more information, please refer to the following links.

Product Webpage
Product Documentation
“How To Get Started” Webinar



Leave a Reply

Your email address will not be published. Required fields are marked *