Hortonworks Connected Data Platform allows enterprises to seamlessly collect and analyze streaming data from the Internet of Things (IoT) and perform real-time, large-scale and high speed analytics on this vast volume of data to generate immediate insights.
Real-time streaming data and analytics are necessary to achieve the business results enterprises are looking for but building these systems are often painstaking piecemeal integration projects that take an army of individual experts to deliver.
CHALLENGES OF STREAMING IOT DATA COLLECTION AND DATA ANALYSIS
Streaming IoT data collection
Secure collection at scale
Reliable data transport
Large numbers of distributed devices
Geographically dispersed environments
Variable bandwidth conditions
Limited or fluctuating resource conditions
Timely access to relevant data
Streaming IoT data analysis
Time to realize streaming insights
Easy access to real-time data
Dependence on specialized skill sets
Development time required
Swift manipulation of large data sets
Integrated collection and analysis
Time to integrate collection and analysis
Skills to deploy and maintain systems
Scalability across many of sources
Adaption rate to dynamic changes
Ease of access to real-time data
To maximize the benefit of IoT data, enterprises need an integrated platform to leverage the ability to collect, analyze and act upon this streaming data in real-time. Collection and analysis need to be supported in a secure, scalable and reliable manner, adapting for dynamic fluctuations inherent in changing physical conditions over time. Analysis of real-time streaming data needs to be as easy as possible, in order to capitalize on the benefits of perishable insights generated by IoT data.
Hortonworks supports streaming analytics and the Internet of Things through Hortonworks DataFlow —an integrated data-source agnostic collection platform powered by Apache NiFi and Apache MiNiFi, along with the powerful streaming analytics capabilities of Apache Kafka and Storm. Together, this enables enterprises to leverage real-time streaming data through a single integrated offering for data collection from the very edge of an enterprise’s presence together with analytics accommodating the variety, velocity and volume of big data generated by the Internet of Things.
IoT and Connected Cars
Real-time streaming analytics enables smart cities and connected cars to respond to real-time road and weather conditions. Watch Hortonworks and the connected car in action.
Finance and Retail
Consumers and retailers benefit from the availability of real-time data and insights. Credit card fraud can be detected in real time, and retailers can create a real-time single view of a customer that enables a real-time recommendation engine.
Apache MiNiFi is designed to make it practical to enable data collection from the second it is born, ideal for IoT scenarios where there are a large number connected devices or a need for a smaller and more streamlined footprint than Apache NiFi. Join us as we walk through how Apache MiNiFI works, and how…
Data Lake 3.0: What’s a self-driving car got to do with Data Lake 3.0?
This blog has contributions from: Vinod Vavilapalli, Wangda Tan, Gour Saha, Priyanka Nagwekar, Sunil Govindan You have probably wondered what makes a self-driving car intelligent to process the live camera feeds, navigate the busy streets and distinguish objects on the streets, such as cars, trucks, traffic lights or pedestrians? A self-driving car is a perfect…
Part 4: SAM’s Stream Builder – Building Complex Stream Analytics Apps without Code
This blog was co-authored by: George Vetticaden, Sriharsha Chintalapani, Jungtaek Lim, Sanket Shah Last week, in Part 3 of this blog series, we announced the GA of HDF 3.0 and let the cat out of the bag by introducing the new open source component called Streaming Analytics Manager (SAM), an exciting new technology that helps developers,…
Expressway Authorities do Hadoop Every day, Expressway Authorities must make critical decisions -- often times without sufficiently accurate and transparent data. At the same time, they may be losing revenue due to reporting latency and the inability to respond when toll plaza sensors are down. Hortonworks DataFlow (HDF™) and Hortonworks Data Platform (HDP®), can help resolve these…
Time is running out to secure your spot at DataWorks Summit/Hadoop Summit. With over 170 sessions featuring top organization using open source technologies to leverage their data, drive predictive analytics, distributed deep-learning, and artificial intelligence initiatives, you don’t want to miss the industry’s premier event. Join us June 13 – 15 in San Jose and save…
Destination Autonomous The march towards autonomous vehicles continues to accelerate. While expert opinion differs on the specific timing and use cases that will emerge first, few deny that self-driving cars are in our future. Not surprisingly, when reviewing Big Data strategies with my automotive clients, discussions on data management strategies for autonomous driving research inevitably…
Open Energi on the Business Value of Hortonworks Technical Expertise
Open Energi is a UK clean tech company working with businesses to intelligently optimize their electricity demand and to deliver both revenue and cost savings. The company pioneers in its market in terms of services, real-time analytics, machine learning, and Internet of Things (IoT). Through Hortonworks Data Platform (HDP) and DataFlow (HDF), Open Energi developed…
Part 2 of HDF Blog Series: A Shared Schema Registry: What is it and Why is it Important?
In Part 1 of this series, we discussed how data-in-motion solutions require both flow management and stream analytics capabilities. Also, we introduced an exciting new technology that Hortonworks is in the process of releasing that helps users build streaming analytics apps faster and caters to three different personas in the enterprise: app developer, operations teams and the…
Three Things I Learned at Yesterday’s Smart City Conference in Silicon Valley
Yesterday, I got to attend the Next-Generation Smart Cities conference as part of the Smart Cities Week® Silicon Valley show here near our office in Santa Clara. I attended with Mark Sanders, our Hortonworks account rep who covers SLED (State and Local Government and Education) for the West. Mark travels the western U.S., working with…
Trust Your Data: How an International Data Company Built Veracity
Three weeks ago, at the DataWorks Summit in Munich, we announced the Data Hero winners for the EMEA region. The winner in the Data Scientist category was Rene Castberg, Senior Researcher at DNV GL. You can read the announcement here. DNV GL is headquartered in Oslo, Norway, and operates in over 100 counties. It provides services for several industries including maritime, renewable…
The automotive industry is going through profound change driven by a myriad of new data sources and the new business models that they enable. Just last week, it was reported that Intel paid $15B for Mobileye, a technology company that allows autonomous vehicles to “see” through cameras and other sensors. Mobileye also allows crowdsourcing data…
LIXIL Uses HDP to Be First in Manufacturing for the Japanese Smart Home Market
Hortonworks continues to expand its list of customers in the Asia Pacific region, as well as in the housing and building industry. We recently completed a case study to showcase how LIXIL Corporation uses HDP to be first in manufacturing for the Japanese Smart Home Market. READ THE FULL LIXIL CASE STUDY HERE LIXIL is a…
Combining IOT, Customer Experience, and Enterprise Data What if you could derive real-time insights using ALL of your data? Join us for this webinar and learn how companies are combining “new” real-time data sources (i.e. IOT, Social, Web Logs) with continuously updated enterprise data from SAP and other enterprise transactional systems. This provides deep and up-to-the-second analytical…
Abundant Data: The Currency For Digital Transformation
Data is the currency for a digital transformation is a theme that came out loud and clear during last week’s Gartner Data and Analytics Summit. This event for the first time brought together two popular conferences - Analytics and Master Data Management (MDM). The result was a very enjoyable time with tons of great conversations and…
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, HAWQ, Zeppelin, Atlas, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.