Hadoop Ecosystem

Industry news, partner stories, buzz and happenings

Today, Rob Rosen, Senior Director Partner Solutions at Platfora, tells us more about the partnership with Hortonworks and how the two companies enable the enterprise to run analytics at scale, in their big data environment.

The Hadoop market has increasingly gained traction in a world that generates over 2 billion gigabytes of data every day. Top enterprises have turned to Hadoop as their solution to better manage, store, and process their structured and unstructured data.…

The Spark lit in Azure HDInsight last week was just the beginning to this week’s energy and momentum we saw around the partnership at Microsoft’s Worldwide Partner’s Conference.  During the conference keynote, Microsoft CEO Satya Nadella affirmed, “Together with our partners we are transforming the business world for the next era”.

This year’s big announcement of Apache Spark being brought to HDInsight was the latest Big Data announcement delivered by Microsoft and Hortonworks.…

Microsoft’s Worldwide Partner Conference is well underway. The conference is a great opportunity for Microsoft’s partner community to understand key marketing and business strategies and engage with the Microsoft community. At this year’s conference, Microsoft’s National Sales Organization announced its 2015 Partner of the Year awards, and Hortonworks has been recognized with the Cloud Partner of the Year Award for both the West and Central U.S. Regions.

The Hortonworks team is honored to receive the Enterprise Partner Group Cloud Partner of the Year Award – an honor that we received thanks to our longstanding relationship with Microsoft.…

Apache Spark has garnered a lot of developer attention and is often the top of agenda in my customer interactions. Since we announced support for Spark in HDP, we have seen broad customer adoption of our Spark offering. Our customers love Spark for the simplicity of its API, speed of development and the runtime performance. Spark is also democratizing Machine Learning and making it easier and approachable to more developers.

Today Microsoft announced support for Spark in HDInsight – this is a big step towards driving customer adoption for Spark workloads on Hadoop clusters in Azure.…

Hortonworks is always pleased to see new contributions come into the open-source community. We worked with our customer, Hotels.com, to help them develop libraries and utilities around Apache Hive, the Apache ORC format and Cascading. It’s great to see the results released for the community. In this guest blog, Adrian Woodhead, Big Data Engineering Team Lead at Hotels.com, discusses the CORC project.

Hotels.com is pleased to announce the open source release of Corc, a library for reading and writing files in the Apache ORC file format using Cascading.…

The Apache Lucene/Solr community is continuing its rapid release cycles to meet community and customer requirements. In this guest blog, we have invited Sarath Jarugula from Lucidworks to share with us the many improvements in the Apache Solr 5.2 release.

The Apache Solr community has announced its Solr 5.2 release. Solr 5.2 is a follow-up release to Solr 5.0, a significant major release in February 2015. The community has delivered 25 new features, 5 optimizations, and 38 bug fixes in this release.…

Oracle and Hortonworks continue to work on bringing the latest ELT and real-time transactional data streaming capabilities to the Hortonworks Data Platform (HDP).   Recently Oracle completed certification testing for HDP 2.2 for both Oracle Data Integrator and Oracle GoldenGate for Big Data, both integral parts of the Oracle Data Integration product portfolio. These releases certified on HDP 2.2 are the latest in the series of advanced Big Data updates and features that Oracle Data Integration is rolling out for customers to help take their Hadoop projects to the next level of enterprise integration.…

As businesses continue to create data at an ever-increasing pace, data architectures are strained under the loads placed upon them. Data volumes continue to grow considerably, low-value workloads like ETL consume more and more processing resources, and new types of data can’t easily be captured and put to use. Organizations struggle with escalating costs, increasing complexity, and the challenge of expansion.

This coming Wednesday, Big Data experts will look at how Hadoop is enabling a broad range of organizations to address these challenges.…

Sumeet Kumar Agrawal, principal product manager for Big Data Edition product at Informatica, is our guest blogger. In this blog, explains how Informatica’s Big Data Edition integrates with Tez and allow for significant performance gains.

Informatica Big Data Edition’s codeless visual development environment accelerates the ability of enterprises to take advantage of amazing innovations in big data to solve new challenges with skill sets that already exist within many organizations. Informatica natively integrates with big data platforms like Hadoop and NoSQL to enable next-generation big data solutions, including data warehouse optimization and 360 customer analytics.…

Our guest blogger today is Sean Anderson, Manager of Data Service at Rackspace, the managed cloud company. Sean will share with us all the work Rackspace is doing with Hortonworks Data Platform (HDP) for an an Enterprise-ready Hadoop solution.

Rackspace is excited to be joining the open source data platform community for Hadoop Summit 2015 hosted by Hortonworks and Yahoo. We partnered with Hortonworks in 2013 to build two platforms—one that delivers enterprise-ready Hadoop on-demand in the cloud, and another that delivers customizable and secure dedicated servers backed by fanatical support and expertise.…

This is a guest blog post from Jerry Megaro, Merck’s Director of Innovation and Manufacturing Analytics. Jerry established the practice of Data Excellence and Data Sciences within the Merck Manufacturing Division and now leads initiatives to transform Merck Manufacturing into a data-driven organization that enhances the company’s performance across the supply chain.

Hortonworks experience working with top pharma manufacturers indicates an exciting opportunity to improve manufacturing performance by proactively managing process variability.…

Bit Refinery is a Hortonworks Technical Partner and recently certified with HDP. Bit Refinery is a VMware© Cloud Infrastructure-as-a-Service (IaaS) provider featuring virtualization technology hosted within their fully redundant virtual data centers. Bit Refinery offers a hosted Hortonworks Sandbox providing an easy way to experience and learn Hadoop with ease. All the tutorials available from the Hortonworks Sandbox work just as if you were running a localized version of the Sandbox.…

In this guest blog, Sumeet Kumar Agrawal, principal product manager for Big Data Edition product at Informatica, explains how Informatica’s Big Data Edition integrates with Hortonworks’ security projects, and how you can secure your big data projects.

Many companies already use big data technology like Hadoop for their production environments, so they can store and analyze petabytes of data including transactional data, weblog data, and social media content to gain better insights about their customers and business.…

Since the launch of Hortonworks Data Platform (HDP) three years ago, we have seen first hand how Enterprises are embracing Apache Hadoop to enable their modern data architecture’s and power new analytics applications. Hadoop is helping organizations transform their business by providing them with a pervasive, enterprise ready data platform to meet their big data challenges.

Apache Hadoop’s ability to process any data (i.e., clickstream, web and social, IoT, etc.) allows an Enterprise to derive insights in ways that were previously either technologically or economically not possible. …

It’s been a busy few weeks here at Hortonworks and much of that busyness comes from all of the things we’ve been doing with our partners. This has been a stretch of time that we’ve affectionately been calling May-magedon with 9 major partner related events in a two and a half week span. We love telling the story of of the transformative nature of Apache Hadoop along with the increasing pervasiveness of enterprise Hadoop driven through a vibrant ecosystem.…