Hadoop Ecosystem

Industry news, partner stories, buzz and happenings

Guest blogger David Hill, Business Development Director at Open Energi, explains the challenges of building a virtual power station, and why data is the fuel. Follow Open Energi on @openenergi

Open Energi is working with businesses in the UK to harness the flexible energy demand from their equipment and aggregating it to create a virtual power station. We’re turning the whole system on its head so that instead of energy supply adjusting to meet demand, our demand for energy adjusts to meet supply – in real-time.…

Today’s guest blogger is from Hortonworks Technology Partner, WANdisco. Peter Scott, SVP of Business Development and OEM Sales at WANdisco, talks about how to easily migrate from one Hadoop distribution to Hortonworks Data Platform (HDP).

Migration between Hadoop versions and distributions can be difficult, often causing extended downtime and disruption, unless you use the right tools. DistCp (distributed copy) is a tool available from Apache™ Hadoop®  used for large inter/intra-cluster copying from Apache.…

Our guest blogger today comes from our partner Talend, who has been working with us for many years to help organizations transition from data chaos to a modern data architecture. In this blog, Talend’s Ashley Stirrup, CMO, talks about a helping organizations to support a dynamic data supply chain.

In order to remain viable in increasingly competitive markets, companies must create ever-more detailed models of the business that incorporate all data – regardless of source or volume.…

Are you still learning about the Data Lake? Wondering how it can help your organization manage and leverage massive amounts of data? On September 8th, VHA, the largest member-owned health care company delivering supply chain management services and clinical services to its members, will share their experience and explain how they simplified data management and enabled faster data discovery with Hadoop and data virtualization.

Register Now

At VHA, product, supplier and member information, among other data, was siloed across multiple sources.…

This blog is jointly submitted by Alexander Gray, Ph.D., is chief technology officer, Skytree, a Hortonworks Technology Partner, and Eric Thorsen, general manager, consumer products and retail, Hortonworks.

As consumers increasingly reveal their shopping habits online, retailers can access social media, purchase history, consumer demand and market trends to better understand their customers, maximize spending and encourage repeat purchases. Retailers are considered early adopters of big data technology, integrating it into every imaginable business process to achieve a deeper understanding of consumers and associated buying trends.…

Today, Tech Mahindra announced that their in-house developed analytics platform Tech Mahindra Analytics Platform (TAP) has joined the family of Hortonworks certified partners and products. As part of Hortonworks’ continued focus on the expansion of the Apache™ Hadoop® ecosystem, Tech Mahindra recently completed extensive certification testing on the Hortonworks Data Platform (HDP). Not only is Tech Mahindra a certified HDP Ready partner, they are also certified as HDP YARN Ready and as an HDP Systems Integrator Gold partner.…

Today, Ernst & Young LLP announced today a strategic business relationship with Hortonworks, Inc.® to provide new data management offerings that leverage and extend Hortonworks Data Platform (HDPTM) together with EY’s data and information management services. EY has been building expertise and solutions around Hadoop to help data driven organizations leverage newly available data (structured and unstructured) to gain better insights and increase operational efficiency, improve profitability and reduce costs, ultimately with a goal to obtaining a competitive edge in the marketplace.…

In this Hortonworks’ partner guest blog, Jorik Blaas, chief technical officer at SynerScope, explores a use case in a new class of exploratory analytics, using Apache Spark on YARN, HDP and SynerScope.

Preliminaries

SynerScope is a pioneering developer of fast, sense-making Big Data Analytics technology. Focusing on human-in-the-loop analytics, we excel at combining heterogeneous data sources to enable a new class of exploratory analytics. By leveraging the Hortonworks Data Platform (HDP) platform through Apache Spark on YARN, we are able to bring agile lock-in-free analytics at scale to our market.…

In this Hortonworks’ partner guest blog, Abhimanyu Aditya, Senior Product Manager and co-founder at Skytree, explains how Skytree APIs solve challenges facing data engineers, simplifies data preparation and data transformation, using Apache Spark on YARN with Hortonworks Data Platform (HDP).

Challenges Facing Data Engineers and Data Scientists

Machine learning as a technology can be challenging. It is difficult to create, understand and deploy machine learning models. Even before the modeling process can begin, the data needs to be prepared for machine learning and modern data scientists, developers, hackers, Ph.D.’s, analysts and domain experts spend a significant amount of time and effort doing this.…

In this guest blog,  Murthy Mathiprakasam, principal product marketing manager at Informatica, tells us more about the partnership with Hortonworks and how the two companies optimize the entire big data supply chain on Hadoop, turning data into actionable information to drive business value.

There has never been a more exciting time in the world of data management. With a growing number and type of data consumers seeking access to growing data volumes and data varieties, the role of data in organizational success has never been more critical.…

In this guest blog, Oliver Chiu, Microsoft’s product marketing manager for Hadoop/Big Data and Data Warehousing, explains how customers can benefit from deploying Apache Spark and HDP on Azure HDInsight for their enterprise and mission-critical big data jobs.

On July 10, Microsoft announced the public preview availability of Apache Spark for Azure HDInsight.

Azure HDInsight is Microsoft’s managed Hadoop-as-a-service offering. It takes the Hortonworks Data Platform (HDP) and architects it for the cloud.…

Open Enterprise Hadoop is already transforming many industries, accelerating Big Data projects to help businesses translate information into competitive advantage.

I’d like to share a real-world example from the digital marketing powerhouse Webtrends, who’ve used the Hortonworks solution to launch a powerful new product line. First, a little context.

Everywhere you look, you can find companies using Open Enterprise Hadoop in large-scale projects to enable deep data discovery, to capture a single view of customers across multiple data sets, and to help data scientists perform predictive analytics.…

This is a guest blog from Stefan Kupstaitis-Dunkler, Accenture Technology Solutions GmbH.

I’ve been working at Accenture for almost a year and last month I was invited to attend the partner masterclass on HDP 2.3 Security. The classroom setting was a great forum for interactive discussions and a showcase of the security capabilities in the newest version of the Hortonworks Hadoop distribution, HDP 2.3.

Sean Roberts, Hortonworks Solution Engineer and hadoop operations expert in EMEA, guided the attendees through a demonstration of what Hortonworks Data Platform does to integrate the security aspects into Hadoop.…

On August 19th, Dr. Alexander Gray, CTO and Co-Founder, Skytree, and Cindy Maike, General Manager, Insurance at Hortonworks, will be joining Patricia Harman, Editor-in-Chief at Claims Magazine, for a Skytree webinar on “Driving profitability and lowering costs using Machine Learning on Hadoop.”

Register for the Webinar on August 19th at 10am Pacific/1pm Eastern time

In this blog, Alex and Cindy exchange perspectives on what machine learning means for insurers, and where opportunities are for its application.…

Today, we were pleased to announce the selection of Hortonworks to the EMC Select Program. We’re delighted to host this guest blog from from Ryan Peterson, the Chief Solutions Strategist at EMC. Follow Ryan @BigDataRyan.

Today, Hortonworks and EMC announced a broadened relationship. Hortonworks announced that EMC has chosen Hortonworks as an EMC Select Partner,which means that EMC will now be able to resell the Hortonworks Data Platform (HDP).…