Compression configuration

to create new topics or reply. | New User Registration

This topic contains 1 reply, has 2 voices, and was last updated by  Larry Liu 2 years, 3 months ago.

  • Creator
    Topic
  • #23010

    bruno bonnin
    Participant

    Hello,

    I have a running cluster, and I want to update the mapreduce compression properties :
    – mapred.compress.map.output = true
    – mapred.map.output.compression.codec = org.apache.hadoop.io.compress.SnappyCodec
    – mapred.output.compress = true
    – mapred.output.compression = org.apache.hadoop.io.compress.SnappyCodec

    Is there a way to do this configuration using Ambari ? I cannot see these parameters in mapred-site.xml and the checkbox of “Snappy compression” is disabled in Ambari :-(

    Thanks for any help !

    Bruno

Viewing 1 replies (of 1 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #23011

    Larry Liu
    Moderator

    Hi, Bruno,

    What you can do is to put the value into the Custom MapReduce Configs under mapreduce advanced config.

    Hope this helps

    Larry

    Collapse
Viewing 1 replies (of 1 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.