Permission Error with MapReduce

to create new topics or reply. | New User Registration

This topic contains 2 replies, has 2 voices, and was last updated by  gehhrald 1 year, 5 months ago.

  • Creator
    Topic
  • #42646

    gehhrald
    Member

    Hi, I have an error while running the mapreduce jar file in Eclipse Kelper. I have 2 slaves set up using Hortonworks CentOS and 1 Master set up in my Virtual Machine.

    Here is the error message from Eclipse console:

    13/11/01 10:51:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    13/11/01 10:51:03 ERROR security.UserGroupInformation: PriviledgedActionException as:Viewer cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-(myusername)\mapred\staging\(myusername)1688921109\.staging to 0700
    Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-(myusername)\mapred\staging\(myusername)1688921109\.staging to 0700
    at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691)
    at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:664)
    at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514)
    at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349)
    at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:192)
    at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:126)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:942)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Unknown Source)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353)
    at hdfs.HashMapReduce.main(HashMapReduce.java:78)

    The code i’m running is the wordcount v1.0 example given on Apache Hadoop website:

    http://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html

Viewing 2 replies - 1 through 2 (of 2 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #43034

    gehhrald
    Member

    Hi,

    Thanks for the link. I’m unable to run the example successfully on the HDP cluster. However, I tried the “hadoop-examples.jar” to run the wordcount and it works inside the HDP. Still can’t solve the permission issue despite trying the solution in the link provided by Koelli.

    Cheers,
    Gerald

    Collapse
    #42865

    Koelli Mungee
    Moderator

    Hi,

    Are you able to run the same example successfully on your HDP Cluster. Perhaps you may be hitting the same issue documented in this jira. Can you have a look?

    https://issues.apache.org/jira/browse/HADOOP-8089

    Regards
    Koelli

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.