MapReduce Problems with Snappy on HDP 2.06 Update to 2.2

to create new topics or reply. | New User Registration

This topic contains 0 replies, has 1 voice, and was last updated by  systec2 1 year, 7 months ago.

  • Creator
  • #45667


    I installed HDP with Update to Hadoop 2.2 with snappy (from hdp-utils on SUSE Linux Enterprise Server – Service Pack 3 according to instruction on HDP-Documentation “Installing HDP Manually” 10/22/2013
    During the execution of a MapReduce-Job, which takes up an snappy-compressed file, the following error occured:

    Error: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

    I’ve tried the HDP-Sandbox (CentOS 6.4 based) for VirtualBox too, but there isn’t snappy installed or configured.
    What’s going wrong?
    I’ve also had run the MR-Job with DEBUG option, but only the Error-Message above was displayed.
    Next try was installation of Hadoop tar-ball (HDFS/MR) from Apache and there the MR-Job is working well.

You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.