Translating your SQL Skills to Hadoop

Hadoop jobs have grown 200,000%. No, that’s not a typo. According to, Hadoop is one of the top 10 job trends right now.

Hadoop Job Trends graph sql Job Trends graph

When you look at LinkedIn, the growth in profiles that have SQL in them is on the downswing — about -4%, but the growth of profiles that have Hadoop in them is up 37%. Hadoop is becoming a clear resume differentiator. Updating and maintaining technical skills has always been part of the job and is part of ensuring a long and healthy career. But that can be easier said than done.

Translating SQL Skills to Hadoop

The need for RDBMS (and other DB) skills is not going away, and Hadoop isn’t a replacement for those systems. Rather it’s an augmentation of those systems for scenarios involving the volumes of data that they can’t efficiently tackle. There’s still a robust market tons of job listings, but not a lot of growth.

Does learning Hadoop mean you have to start all over again? No, learning Hadoop is an evolution, not a revolution. While Hadoop may be a hot new technology, if you’re already comfortable with SQL, then learning how to use Hive (one of the key projects within the Hadoop ecosystem) will feel very familiar as it’s syntax and commands are very SQL-like – deliberately so.

Hortonworks’ Stinger Initiative has the goals of improving the performance of Hive to familiar ‘interactive time’ querying across large data sets and moving ever closer to full compliancy with SQL-92. If you’re already comfortable with SQL, then this technology shift will feel less like writing with the other hand but more like learning to write with a new pen. It’s not a revolution in your skills, it’s simply an evolution.

Not only is Hive very SQL-like, Hadoop is a “+1″ in your environment, a perfect complement to your existing data warehouse, storage and database infrastructures. As part of the modern data architecture, Hadoop enables data refinement and exploration at scale in a cost effective way across commodity hardware and unlocks the value of your big data to enrich your apps and experiences. With Hadoop as an addition to your architecture, you can continue to run the infrastructure you’re comfortable with and yet still gain all of the advantages of Hadoop.

So, what’s the easiest way for you to learn more about Hive?  We have a simple 3 step process for you:

1) Explore

2) Download the Hortonworks Sandbox

It’s a free, single-node, personal Hadoop environment that is a learning platform as well. You can follow along with the tutorials in the Sandbox, and then safely go off-roading to experiment and learn as the Sandbox is a complete Hortonworks Data Platform environment where you can upload your own datasets and connect to your favorite BI tools. No AWS accounts needed, no space in your data center required, allowing you to run a fully functional node of Hadoop on your laptop while you’re in a plane, train or automobile.

3) Attend a Hortonworks University Class

*Note, these statistics are valid as of July 2013.

Categorized by :
Hadoop Ecosystem Hive Sandbox

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Try it with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.

Get Sandbox

Join the Webinar!

Big Data Virtual Meetup Chennai
Wednesday, October 29, 2014
9:00 pm India Time / 8:30 am Pacific Time / 4:30 pm Europe Time (Paris)

More Webinars »

HDP 2.1 Webinar Series
Join us for a series of talks on some of the new enterprise functionality available in HDP 2.1 including data governance, security, operations and data access :
Contact Us
Hortonworks provides enterprise-grade support, services and training. Discuss how to leverage Hadoop in your business with our sales team.
Integrate with existing systems
Hortonworks maintains and works with an extensive partner ecosystem from broad enterprise platform vendors to specialized solutions and systems integrators.