Home Forums HDFS Compression configuration

This topic contains 1 reply, has 2 voices, and was last updated by  Larry Liu 1 year, 3 months ago.

  • Creator
    Topic
  • #23010

    bruno bonnin
    Participant

    Hello,

    I have a running cluster, and I want to update the mapreduce compression properties :
    - mapred.compress.map.output = true
    - mapred.map.output.compression.codec = org.apache.hadoop.io.compress.SnappyCodec
    - mapred.output.compress = true
    - mapred.output.compression = org.apache.hadoop.io.compress.SnappyCodec

    Is there a way to do this configuration using Ambari ? I cannot see these parameters in mapred-site.xml and the checkbox of “Snappy compression” is disabled in Ambari :-(

    Thanks for any help !

    Bruno

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #23011

    Larry Liu
    Moderator

    Hi, Bruno,

    What you can do is to put the value into the Custom MapReduce Configs under mapreduce advanced config.

    Hope this helps

    Larry

    Collapse
Viewing 1 replies (of 1 total)