Hadoop Ecosystem

Industry news, partner stories, buzz and happenings

By now, we have all heard about Big Data. However, approaches to derive value from the phenomenon vary greatly from one organization to another. While companies like Facebook, Google or Yahoo! were birthplaces of game-changing innovations, most corporations are still trying to figure out how to unlock the power of Big Data.

In this video series created in collaboration between Informatica and Hortonworks, two pioneers and leaders in the data space, you will hear about a wide range of topics addressed in simple business terms.…

Talend is a Hortonworks Certified Technology Partner, and our guest blogger today is Shawn James, director, big data business development, Talend. Shawn and Jim Walker, director of product marketing at Hortonworks, are our guest speakers in an upcoming webinar on Feb. 12th.

If you are a data scientist, MapReduce or Hadoop developer, you are in demand given the massive increase in data science-based projects. These projects are being driven by the private sector of course, but also by a public sector that is looking to tackle a new range of use cases using big data.…

Informatica users leveraging HDP are now able to see a complete end-to-end visual data lineage map of everything done through the Informatica platform. In this blog post, Scott Hedrick, director Big Data Partnerships at Informatica, tells us more about end-to-end visual data lineage.

Hadoop adoption continues to accelerate within mainstream enterprise IT and, as always, organizations need the ability to govern their end-to-end data pipelines for compliance and visibility purposes. Working with Hortonworks, Informatica has extended the metadata management capabilities in Informatica Big Data Governance Edition to include data lineage visibility of data movement, transformation and cleansing beyond traditional systems to cover Apache Hadoop.…

DataTorrent is a Hortonworks Certified Technology Partner and YARN Ready, offering an enterprise class real-time streaming platform on Hadoop and Hortonworks Data Platform. Thomas Weise, principal architect at DataTorrent, is our guest blogger today.

A while ago, DataTorrent announced a new initiative to integrate Kafka and YARN under the KOYA project. KOYA was proposed as KAFKA-1754 and well received by the community.

Why KOYA?

Kafka is becoming increasingly popular as the data bus to move data in and out of Hadoop clusters.…

Novetta is an HDP Certified Technology Partner and YARN Certified, delivering agile big data analytics solutions with HDP. In this blog, Jennifer Reed, director of product management at Novetta, shares a recent customer use case in the Oil and Gas vertical market.

Energy companies discover and develop petroleum resources to meet the needs of the global economy. Often, this requires working in areas of the world where organized crime, piracy, and terrorist activity are common and, conversely, where governmental protection is limited.…

VoltDB is a Certified Hortonworks Technology Partner and developers of an in-memory relational DBMS capable of supporting high volume OLTP and real-time analytics with Hortonworks Data Platform. Our guest blogger today is John Piekos, vice president of engineering at VoltDB.

It’s a common phrase here at VoltDB: Streaming Apps are Really Database Apps When You Use a Database that’s Fast Enough.

What does that mean?

We’re seeing a trend: developers are struggling to create interactive, real-time applications on fast streaming data.…

Our guest blogger is Carole Murphy, director of product marketing for Voltage SecureStorage at Voltage Security, a Hortonworks Certified Technology Partner.

The demand for Hadoop is accelerating, as enterprises move from proof of concept to full production implementations. With the move to modern data architecture, data security and compliance has become a growing concern.

Securing data in Hadoop is a hot topic and the Hadoop community is investing and providing value-added capabilities in security and governance.…

We are living in a hyper connected world. Digitization has lead to massive improvements in human productivity and enabled us to find solutions that would otherwise be simply impossible. Spurring digitization has been a perfect confluence of network, compute and analytics. Thanks to cloud computing, individuals and enterprises of any scale can continuously collect & process data using dynamic compute resources. Advanced scale out analytics has enabled enterprises to derive insight and operationalize them for improved outcomes.…

Have you ever wondered how to share content infrastructure that transparently synchronizes information with your existing systems? Are you looking for ways to build an open standards-based platform for deep analysis and data monetization? If so, you will want to join our webinar on Wednesday, January 21st, at 10 AM PT.

Our Big Data experts will teach you how to:

  • Leverage 100% of your data, including text, images, audio, video, and many more data types to be automatically consumed and enriched using HP Haven and Hortonworks Data Platform (HDP).
  • Cindy Maike, GM, Insurance at Hortonworks

    Financial services and the insurance industry are projected by many research organizations to benefit significantly from the usage of new information and advanced analytics by blending new data sources. As an industry, insurance depends on data; however, we have always had to struggle with it and now, we have an explosion of new data available.

    The key is to determine what new information is important to your business strategy and what new questions it can provide insights for, and weave that into existing data sources.…

    Our SI partner Ingenious Qube worked with a customer who wanted to price auto insurance based on driving behavior insights obtained from sensors on cars using Hortonworks Data Platform. Rajnish Goswami, CEO of Ingenious Qube, describes the customer story below.

    The Situation

    Insurance companies around the world strive to provide lower insurance rates, and auto insurance is no exception to this phenomenon. The automobile insurance companies are devising ways to derive innovative pricing models that will help customers reduce their insurance premiums; however, it requires an understanding of how one drives their vehicle.…

    This guest blog post is from Srikanth Venkat, director of product management at Dataguise, a Hortonworks security partner.

    Plus ça change, plus c’est la même chose As Jean-Baptiste Alphonse Karr noted “The more things change, the more they stay the same.” Often, that’s not what we hear when looking at Hadoop security: people tend to call out how different Hadoop is, and how different its security solutions need to be.…

    Hortonworks introduces HDP Operations Ready, HDP Security Ready and HDP Governance Ready certifications to showcase solutions that deeply integrate with enterprise Hadoop.

    Customer adoption of Apache Hadoop continues to accelerate the pace at which the community works to meet the requirements of Enterprise Hadoop. Once the place of HDFS and MapReduce only, the introduction of Apache Hadoop YARN a little over a year ago has unleashed many new ways to get value from a Hadoop cluster.…

    As more organizations consider the cloud as a component of their Apache Hadoop deployments, we can look to our partners for a range of solutions designed to meet these needs. This is the first post in a series on partner solutions available for deploying Hadoop in the cloud. We will build on the Hybrid deployment post with general use cases for Hadoop in a Hybrid cloud. Through our partners we have broad set of options for the cloud available today spanning on-premises, virtual and cloud-based deployments.…

    Data platforms within Enterprises are in midst of a generational shift. After successful reliance on databases for decades, leading organizations today are complementing their data platforms to create a Modern Data Architecture (MDA) with Apache Hadoop in a Data Lake environment. Hadoop with its scale out and schema free architecture enables organizations to store and analyze all its structured and unstructured data in a single consolidated data environment. A key partner in the Hadoop journey has been the complementary infrastructure of server, storage and networking.…