MapReduce Forum

MapReduce Problems with Snappy on HDP 2.06 Update to 2.2

  • #45667
    systec2
    Participant

    I installed HDP 2.0.6.0 with Update to Hadoop 2.2 with snappy (from hdp-utils 1.1.0.16) on SUSE Linux Enterprise Server – Service Pack 3 according to instruction on HDP-Documentation “Installing HDP Manually” 10/22/2013
    During the execution of a MapReduce-Job, which takes up an snappy-compressed file, the following error occured:

    Error: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

    I’ve tried the HDP-Sandbox (CentOS 6.4 based) for VirtualBox too, but there isn’t snappy installed or configured.
    What’s going wrong?
    I’ve also had run the MR-Job with DEBUG option, but only the Error-Message above was displayed.
    Next try was installation of Hadoop tar-ball (HDFS/MR) from Apache and there the MR-Job is working well.

to create new topics or reply. | New User Registration

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.