The Hortonworks Blog

This year’s Insurance Canada Technology Conference will focus on the impact of new technologies in the insurance industry. Key topics include telematics, analytics, the Internet of Things (IoT), and how these capabilities enable insurance companies to improve underwriting and reduce risk.

A recent article at Strategy Meets Action identified digital transformation in the insurance industry as a Top 10 Trend Influencing 2016.

Join Cindy Maike, GM of Insurance from Hortonworks, as she discusses “Data-Driven vs.…

Author: Michael Bironneau, Data Scientist, Open Energi

At Open Energi, we think of our service as an automated, virtual power station. Whenever the electric grid experiences sudden, unforeseen surges in supply or demand, assets under the control of our Dynamic Demand algorithm automatically pick up the slack – just like a power station would but cheaper and cleaner.

In order to prove that we’ve delivered this service and keep it running at optimum, we need to analyse large amounts of data relatively quickly.…

It was 10 years ago today (Feb 2) that my first patch (https://issues.apache.org/jira/browse/NUTCH-197) went into the code that two days later became Hadoop (https://issues.apache.org/jira/browse/HADOOP-1).

I had been working on Yahoo Search’s WebMap, which was the back end that analyzed the web for the search engine.  We had been working on a C++ implementation of GFS and MapReduce, but after hiring Doug Cutting decided that it would be easier to get Yahoo’s permission to contribute to code that was already open source rather than open source our C++ project.…

Do you like looking for the needle in the field of haystacks? Do I have a job for you; security operations center (SOC) analyst. You will spend your days looking at hundreds of thousands of alerts – created by rules engines – where only a very few a week actually matter.  Your job is to manually review all of them, filtering out the noise to find the few that matter.  Yes, it will take hours to review each one and there won’t be enough time in the day to review them all; but, what can you do?…

Recently, Apache Spark set the world of Big Data on fire. With a promise of amazing performance and comfortable APIs, some thought that Spark was bound to replace Hadoop MapReduce. Or is it? Looking closely into it, Spark rather appears to be a natural complement to Apache Hadoop YARN, the architectural center of Hadoop…

Hadoop is already transforming many industries, accelerating Big Data projects to help businesses translate information into competitive advantage.…

A couple of months ago I joined Hortonworks. There was an undeniable pull to go into the fire of crazy fast innovation and growth. About four seconds in, I realized there was so much more than just the pace of execution and growth but rather a bigger opportunity to be a part of something game-changing. The opportunity to partake in trailblazing the world of data. The opportunity to offer a unique value proposition of truly 100% open technology.…

Today we proudly announced that Arkena, one of Europe’s leading media services companies, is using Hortonworks Data Platform (HDP™) to provide its media customers with an advanced analytics platform to deliver content to OTT customers through its content delivery network (CDN). This is a guest post from Reda Benzair the Vice President of Technical Development at Arkena. You can also join Arkena and Hortonworks February 16th for a live and on-demand webinar about their Advanced Analytics Platform click here.…

FireKing offers best-in-class security products for asset protection in retail, commercial, and home office environments.

With Hortonworks Data Platform (HDP®), FireKing now analyzes its operational data to accurately measure the productivity of service technicians, allowing the field service organization to deliver improved customer service while also reducing the costs of servicing safes, cash-management systems, and commercial locking hardware.

Read the Complete FireKing Case Study  

Field Service Challenges Before HDP

FireKing employs over 80 field technicians spread across the continental US, performing nearly 50,000 service jobs per year.…

Santa will be busy this year. On December 24th he’s scheduled to deliver presents to billions of children globally. Buddy and the Keeblers will be working overtime to meet the demand, and Santa has called in temp work from Legolas and Dobby.

There’s little doubt that Santa is a master of lean manufacturing, but there’s only so much muda you can cut from the factory floor. After all, his supply chain has been perfected over decades and his workforce is loyal and perfectly aligned with the mission.…

We are pleased to announce that the 2nd release of Hortonworks DataFlow is now available. Hortonworks DataFlow is a data-source agnostic, real time data collection and dataflow management platform designed to meet the practical challenges of collecting and moving data securely and efficiently.

HDF 1.1 builds on the strength of the initial GA version of HDF released in September 2015. HDF 1.1 supports additional security models, improves the user experience, and increases user options for accessing and delivering data.…

An interesting and atypical thing is happening in Healthcare. Leading data driven organizations are not simply looking to share their Hadoop experiences, successes, use cases, and best practices … but more than ever before, they are embracing the opportunity to share their experiences outside their organizations, in a style that resembles the open source community on which Hadoop was built.

It all started at Hadoop Summit on June 10th 2015 when a simple breakfast meeting was organized to showcase the experiences of a couple of healthcare’s earliest adopters of Hadoop.…

It’s our pleasure to host Ryan Peterson, Chief Solution Strategist at EMC, as a guest blogger to expand upon another great step in our partnership to deliver compelling customer solutions through joint engineering efforts.  Follow Ryan @BigDataRyan.

Object storage isn’t a new concept and EMC’s been innovating around it since the beginning. Take our Centera and Atmos products as key examples. The first Centera was created around the idea that objects could store much higher quantities of data than a file system in a single store while the other aspect of Centera was a rich set of security and compliancy features file systems had not been able to achieve.…

Posted in partnership with Paige Schaefer, Product Marketing at Trifacta.

The insurance industry is wrestling with the tremendous growth of data sources at its disposal. Traditional ETL processes are expensive, time-consuming, and complicated by the variety of data structures and formats. In contrast, Hadoop platforms provide a clean, safe, and manageable format for data wrangling, the critical first step of the data analysis process.

Forward-thinking insurance companies have embraced data wrangling as more than janitorial work.…

Deploying a lock-in free data platform is critical for an enterprise. By this, we mean using a non-proprietary code and implementing interoperability to eliminate the risk of being dependent on a single vendor for your current or future needs.

Over two thirds of respondents to our survey agree that maintaining freedom of choice was a key criterion when it came to selecting the Hortonworks Data Platform. (Source: TechValidate TVID 4A8-731-250.)

They didn’t want to be limited to what one vendor can offer – they wanted to have platform portability, industry-wide standards and choices on third party application support from a broader ecosystem.…

We are in the midst of the third industrial revolution, driven by IoT and Big Data analytics. This is a fundamental blurring of boundaries between the physical and digital worlds, which has resulted in disruptive new business models.

Register now for the Webinar on Thursday, December 10th , at 11:00am PST, with guest speakers Frank Gillett from Forrester Research, Grant Bodley from Hortonworks, Sriram Jayaraman from HARMAN, and Darrell Swope from Landis+Gyr as they look into how IoT and analytics address the opportunities and challenges in the digital economy.…