MapReduce Forum

Permission Error with MapReduce

  • #42646
    gehhrald
    Member

    Hi, I have an error while running the mapreduce jar file in Eclipse Kelper. I have 2 slaves set up using Hortonworks CentOS and 1 Master set up in my Virtual Machine.

    Here is the error message from Eclipse console:

    13/11/01 10:51:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    13/11/01 10:51:03 ERROR security.UserGroupInformation: PriviledgedActionException as:Viewer cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-(myusername)\mapred\staging\(myusername)1688921109\.staging to 0700
    Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-(myusername)\mapred\staging\(myusername)1688921109\.staging to 0700
    at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691)
    at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:664)
    at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514)
    at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349)
    at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:192)
    at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:126)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:942)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Unknown Source)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353)
    at hdfs.HashMapReduce.main(HashMapReduce.java:78)

    The code i’m running is the wordcount v1.0 example given on Apache Hadoop website:
    http://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #42865
    Koelli Mungee
    Moderator

    Hi,

    Are you able to run the same example successfully on your HDP Cluster. Perhaps you may be hitting the same issue documented in this jira. Can you have a look?

    https://issues.apache.org/jira/browse/HADOOP-8089

    Regards
    Koelli

    #43034
    gehhrald
    Member

    Hi,

    Thanks for the link. I’m unable to run the example successfully on the HDP cluster. However, I tried the “hadoop-examples.jar” to run the wordcount and it works inside the HDP. Still can’t solve the permission issue despite trying the solution in the link provided by Koelli.

    Cheers,
    Gerald

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.