The Hortonworks Blog

Traditionally, HDFS, Hadoop’s storage subsystem, has focused on one kind of storage medium, namely spindle-based disks.  However, a Hadoop cluster can contain significant amounts of memory and with the continued drop in memory prices, customers are willing to add memory targeted at caching storage to speed up processing.

Recently HDFS generalized its architecture to include other kinds of storage media including SDDs and memory [1]. We also added support for caching hot files in memory [2].…

Informatica is a Hortonworks Certified Technology Partner. This partnership makes it possible for organizations to use all the data internal and external to an enterprise to achieve the full predictive power that drives the success of modern data-driven businesses. 

That is why we’re excited to have John Haddad, Senior Director, Informatica to be our guest blogger. In this blog, John explores the benefits of certification on HDP 2.1.

When I was in high school, one of my best friends had a water ski boat we often took out on California lakes (what are friends for?).…

Julian Hyde will present the following talks at the Hadoop Summit:

  • Discardable In-Memory, Materialized Query for Hadoop,”  (June 3rd, 11:15-11:55 am)
  • “Cost-based Query Optimization in Hive,” (June 4th,  4:35 pm-5:15 pm)
  • What to do with all that memory in a Hadoop cluster? The question is frequently heard. Should we load all of our data into memory to process it? Unfortunately the answer isn’t quite that simple.

    The goal should be to put memory into its right place in the storage hierarchy, alongside disk and solid-state drives (SSD).…

    We are less than a week away from start of the seventh annual Hadoop Summit San Jose. With all of the final preparations underway, we wish to highlight some of the not to be missed activities in and around the event. The event is filling fast, but you can still register here.

    Here are a few things you don’t want to miss!

  •  Great track content—there is more content than ever with more than 120 informative sessions on Apache Hadoop and related technologies for you to choose from and as always selected by the community and delivered by the experts themselves.
  • Trifacta is a Hortonworks Technology Partner, a pioneer in data transformation, recently certified with HDP 2.1. Here, Trifacta’s CTO and Co-founder Sean Kandel, talks about their Predictive Interaction ™ solution with Hortonworks Data Platform.

    “I spend more than half my time integrating, cleansing and transforming data without doing any actual analysis. Most of the the time I’m lucky if I get to do any analysis.” – Data Scientist [1]

    The most commonly reported use of Hadoop today is data transformation. …

    The Apache Ambari community is happy to announce last week’s release of Apache Ambari 1.6.0, which includes exciting new capabilities and resolves 288 JIRA issues.  

    Many thanks to all of the contributors in the Apache Ambari community for the collaboration to deliver 1.6.0, especially with Blueprints, a crucial feature that enables rapid instantiation and replication of clusters.

    Each release of Ambari makes substantial strides in providing functionality to simplify the lives of system administrators and dev-ops engineers to deploy, manage, and monitor large Hadoop clusters, including those running on Hortonworks Data Platform 2.1 (HDP).…

    Customers want to make more rapid, data-driven decisions but historically this has been challenging in the era of Big Data. Predictive analytics, machine learning and statistical algorithms are at the leading edge of where enterprises can unlock the value hidden in their data to deliver timely insights for intelligent decisions.

    Zementis is a new Hortonworks Technology Partner offering a standards-based predictive analytics scoring engine for Hortonworks Data Platform (HDP) and existing data repositories as part of the Modern Data Architecture (MDA).…

    As SAP’s only partner for 100% open source Apache Hadoop we’re excited to be sponsoring and exhibiting at SAP SAPPHIRE NOW + ASUG Annual Conference. Orlando, FL. June 3 – 5.

    Join us at SAPPHIRE NOW at booth #1611 to learn more about Hadoop and the integration of the SAP suite of solutions and Hortonworks Data Platform (HDP). We’ll have technical and sales specialists there to address any of your questions.…

    In this blog, Paul Phillips, EMEA Sales Director at Hortonworks, discusses the importance of extending big data science courses to PhD students and scientists. This joint venture with KPMG provides an opportunity to “bring excellent basic skills that are useful in data science and this programme aims to commercialize these skills and ease the path to a data science profession.”

    At Hortonworks, we encourage our team members to innovate and as the Open Source community grows, it is also vital that we play our part to ensure the community is continually reinvigorated with new ideas and innovation. …

    On Wednesday May 21, Himanshu Bari (Hortonworks’ senior product manager), Venkatesh Seetharam (committer to Apache Falcon), and Justin Sears ( Hortonworks’ Product Marketing Manager), hosted the third of our seven Discover HDP 2.1 webinars. Himanshu and Venkatesh discussed data governance in Hadoop through Apache Falcon that is included in HDP 2.1. As most of you know, ingesting data into Hadoop is one thing; having data governed, by dictating and defining data-pipeline policies, is another thing—a necessity in the enterprise.…

    According to New York Observer, there were couple of major social reasons that spurred the genesis and growth of Meetup.com. First, it was Robert Putman’s book Bowling Alone, in which he talks about the collapse of communities in America. And the second was an event that not only changed the world but changed New York: it was the aftermath of September 11, where strangers cared about greeting, meeting, and talking.…

    MongoDB is an open-source NoSQL database, used by companies of all sizes, across all industries and for a wide variety of applications. MongoDB – the company – is a Hortonworks Certified Technology Partner.

    Sheena Badani, Director of Business Development at MongoDB, talks about the value of obtaining HDP 2.1 certification.

    MongoDB is thrilled to announce the certification of the MongoDB Hadoop Connector on Hortonworks latest release HDP 2.1.  Customers now have validation from both MongoDB, Inc.…

    Hurry, time is running out to join Mike Ferguson, independent analyst and thought leader in Business Analytics, Big Data, Data Management and Smart Business, as he explores how the growing business demand to analyze new sources of data is impacting on traditional architectures and how these architectures need to change to accommodate big data analytical workloads.

    In this brief session, Mike looks at new analytical use cases, the types of data that need to be analyzed, and the role of Hadoop in a modern analytical environment.…

    On May 15, Owen O’Malley and Carter Shanklin hosted the second of our seven Discover HDP 2.1 webinars. Owen and Carter discussed the Stinger Initiative and the improvements to Apache Hive that are included in HDP 2.1:

    • Faster queries with Hive on Tez, vectorized query execution and a cost-based optimizer
    • New SQL semantics and datatypes
    • SQL-standard authorization
    • The Hive job visualizer in Apache Ambari
    • And many more

    Here is the complete recording of the webinar.…

    Are your business users able to quickly access and report on the massive amount of data flowing into Hadoop? Learn how leading companies are already accelerating the speed of innovation using the combination of Hadoop and the Actian Analytics Platform. In this webinar, Hortonworks and Actian will describe how you can:

    • Deploy modern data architecture accessible to business users
    • Combine flows from any data source and Hadoop to deliver transformative business value
    • Unleash business analysts on Hadoop data without coding
    • Deliver analytic results right at the point of business: the right offer, at the right price, to the right prospect, in a timeframe of relevance

    Register now to accelerate Big Data 2 with Hortonworks and Actian!…

    Go to page:« First...56789...203040...Last »