cta

Get Started

cloud

Ready to Get Started?

Download sandbox

How can we help you?

closeClose button

The Hortonworks Blog

Apache Spark is a powerful framework for data processing and analysis. Spark provides two modes for data exploration: Interactive: provided by spark-shell, pySpark, and SparkR REPLs Batch: using spark-submit to submit a Spark application to cluster without interaction in the middle of run-time. While these two modes look different on the surface, deep down they […]

You have heard about Big Data for a long time, and how companies that use Big Data as part of their business decision making process experience significantly higher profitability than their competition. Now that your company is ready to embark on its first Apache Hadoop® journey there are important lessons to be learned. Read on […]

Hive View 2.0 is New in Apache Ambari 2.5 Ambari’s Hive View gives analysts and DBAs a convenient web interface to Apache Hive which allows SQL analytics, data management and performance diagnostics. Ambari 2.5 introduces Hive View 2.0 with a brand new user experience plus a slew of great new tools to help DBAs run […]

In 2016, we published the second version v1.0.1 of Spark HBase Connector (SHC). In this blog, we will go through the major features we have implemented this year. Support Phoenix coder SHC can be used to write data out to HBase cluster for further downstream processing. It supports Avro serialization for input and output data […]

You may have read yesterday’s blog post that summarizes how Yahoo! Japan, the largest web portal in Japan, scaled its business analytics with access to over 75 petabytes of data in Hortonworks Data Platform (HDP). You can read the full English translation of that Japanese case study here. This post is about SoftBank Corp, another […]

Andrew Ng, the renowned data scientist, has said that artificial intelligence (AI) needs to be a company-wide strategic decision. Companies that don’t strategically invest in AI will slowly lose market share to companies whose core businesses are built around AI. AI enables the prediction, planning and automation of a variety of tasks, and for enterprises, […]

R is one of the primary programming languages for data science with more than 10,000 packages. R is an open source software that is widely taught in colleges and universities as part of statistics and computer science curriculum. R uses data frame as the API which makes data manipulation convenient. R has powerful visualization infrastructure, […]

This is a guest blog post by Charles Boicey, Chief Innovation Officer at Clearsense. Clearsense was born out of a passion for helping healthcare organizations realize the promise of their data and its ability to help them make better, faster clinical decisions—to meet the challenges of value-based care, drive research, improve patient care, and ultimately […]

This week I attended the 2017 Automotive Cyber Security Summit in Detroit with my colleague Mike Schiebel (General Manager, Cyber Security, Hortonworks). Together, we were speakers in a session entitled “Securing the Connected Car in a Connected World”. Here are highlights of what we presented: How Did We Get Here? A Historical Perspective As the […]

Apache Hadoop has always been associated with storing & processing vasts amount of data. But did you know it’s also an awesome engine to power interactive data exploration and visualization? With the development of Apache Hive LLAP (a recent innovation included in the Hortonworks Data Platform), you can use Hadoop with Business Intelligence tools (like […]

HDP 2.6 takes a huge step forward toward true data management by introducing SQL-standard ACID Merge to Apache Hive. As scalable as Apache Hadoop is, many workloads don’t work well in the Hadoop environment because they need frequent or unpredictable updates. Updates using hand-written Apache Hive or Apache Spark jobs are extremely complex.  Not only […]

Now Generally Available in HDP 2.6 Hive LLAP (Low Latency Analytical Processing) is Hive’s new architecture that delivers MPP performance at Hadoop scale through a combination of optimized in-memory caching and persistent query executors that scale elastically within YARN clusters. Hive LLAP — MPP Performance at Hadoop Scale   Since Hive LLAP was introduced as […]

We are thrilled to announce that Hortonworks Data Platform (HDP) version 2.6 is now available – both on pre-premise and in the cloud. For the first time, we are also making this available on IBM Power System in addition to the x86 chipset. During 2016, we have seen many of Hortonworks’ customers deploy more and […]

Human Assisted AI Another common trend is pairing humans to evaluate results from Artificial Intelligence (AI). As great and sensational AI has been made out to be recently, it is still long way from having human-like abilities of comprehension, reasoning and intuition. For instance, in radiology, given lymph node cells, AI alone had 7.5 percent […]

Large-scale Machine Learning The ability to learn without being explicitly programmed, Machine Learning, has been around for a long time and is well understood. What is different is the relatively recent emergence of general purpose tools, such as Apache Spark, that enable processing of very large datasets. Additionally, data scientists can now collaborate and rapidly […]