Get fresh updates from Hortonworks by email

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.


Sign up for the Developers Newsletter

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.


Get Started


Ready to Get Started?

Download sandbox

How can we help you?

* I understand I can unsubscribe at any time. I also acknowledge the additional information found in Hortonworks Privacy Policy.
closeClose button

Principal Software Engineer – Apache Spark

R&D - Core | Bangalore, India

Team Description

Hortonworks is looking for a Principal Engineer with strong distributed systems expertise to join the Data Science Platform team. We are charged with developing a high performance and easy to use platform built using Apache Spark, Livy, Zeppelin and other open source projects, and running across on-premise, cloud and hybrid scenarios.

Key responsibilities:

  • Perform detailed performance characterizations of SQL, streaming and machine learning applications on Spark, on-premise and in the cloud
  • Drive the product roadmap by identifying performance improvements based on repeatable measurements
  • Contribute in developing an Application Performance Management system for distributed Big Data applications
  • Speak and evangelize in conferences and blogs about Big Data performance management


  • BS/MS in Computer Science
  • 10+ years of hands on software design, implementation and test experience with strong understanding of distributed & large-scale systems
  • Demonstrable and strong experience in JVM internals, performance measurement and monitoring tools

Big pluses:

  • Working knowledge of Apache Hadoop, Spark or other big data platforms
  • Comfortable working independently in a fast paced environment

All employees are required to adhere to all Hortonworks employment policies, including without limitation information security policies.


Having gone public with its IPO in December 2014, Hortonworks is experiencing extraordinary growth as we deliver essential support to the burgeoning big data and IoT communities. Hortonworks is an industry leading innovator that creates, distributes and supports enterprise-ready open data platforms and modern data applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Hortonworks is focused on driving innovation in open source communities such as Apache Hadoop, Apache NiFi and Apache Spark. Along with our 2,100+ partners, Hortonworks provides the expertise, training, and services that allow customers to unlock transformational value for their organizations across any line of business.

For more information, visit

Hortonworks, Powering the Future of Data, HDP and HDF are registered trademarks or trademarks of Hortonworks, Inc. and its subsidiaries in the United States and other jurisdictions.



« Back to current openings
Apply Now

Application for employment at Hortonworks

Principal Software Engineer – Apache Spark | R&D - Core | Bangalore, India

Thank you for considering a career at Hortonworks. Please take a minute to fill out the following form. After you have completed your application an email will be sent to you with information about how to check the status of your application.

« Back to current openings