libhdfs testing

to create new topics or reply. | New User Registration

This topic contains 1 reply, has 2 voices, and was last updated by  Dave 1 year, 7 months ago.

  • Creator
  • #45047

    Stephen Bovy

    I am trying to use the sandbox to do some libhdfs regression testing ::

    I need to regression test the thread support with the thread test program This program uses “MiniHdfs”

    I am getting the following permission error :: ( suggestions would be welcome, thanks )

    I logged in as hue but did an su to root ::

    Then I execute the following :: hadoop prgrm ./TstThreadHdfs

    NOTE: the “prgrm” keyword was added by me to support libhdfs programs

    I am getting the following error ::

    nmdCreate: Builder#build error: the path component: ‘/var/lib/hadoop-hdfs’ is owned by a user who is not root and not you. Your effective user id is 0; the path is owned by user id 1004, and its permissions are 0755. Please fix this or select a different socket path.
    at Method)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.getDomainPeerServer(
    at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(
    at org.apache.hadoop.hdfs.server.datanode.DataNode.(
    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(
    at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(
    at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(
    at org.apache.hadoop.hdfs.MiniDFSCluster.(
    at org.apache.hadoop.hdfs.MiniDFSCluster$
    TEST_ERROR: failed on line 318 (errno: 2): got NULL from tlhCluster
    [root@sandbox suselinux-x8664]#

    I do not understand this permission error ( root ) should be able to do anything and everything without restrictions !!

Viewing 1 replies (of 1 total)

You must be to reply to this topic. | Create Account

  • Author
  • #45056


    Hi Stephen,

    Who owns this directory and what are the permissions of var/lib/hadoop-hdfs?
    What does the TstThreadHdfs script(?) do?



Viewing 1 replies (of 1 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.