Hortonworks Sandbox Forum

Unable to access HDFS from host

  • #40449

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #40583
    Dave
    Moderator

    Hi Sawan,

    Having only read a bit about Pentaho, I would expect you connect it to your NameNode.
    As this is running on your host machine, you need to ensure you can connect to 127.0.0.1 on port 8020
    You would need to use the hdfs user, however this doesn’t have a password set, so you should set this in the sandbox when you log in as root.

    Thanks

    Dave

    #40584

    Yes I did the same. I used the IP and port 8020 amd user as sandbox it is unable to connect.

    Is there a way to confirm the hdfs port using netstat?

    #40586
    Dave
    Moderator

    Hi Sawan,

    Yes, run a ps -ef | grep NameNode
    Look for the process like 00:00:31 /usr/jdk64/jdk1.6.0_31/bin/java -Dproc_namenode

    Then do a netstat -anp | grep $PID from above

    It should be 8020, can you telnet to that port on the sandbox from your machine? You could try building a HDP cluster and running it on a static IP instead of localhost?

    Thanks

    Dave

    #40598

    Hi Dave,

    Thanks for quick reply.

    I have taken the screenshot output of netstat – http://imgur.com/rXplyU4

    Thanks,
    Sawan

    #40618
    Dave
    Moderator

    Hi Sawan,

    So 192.1268.16.52 is listening on port 8020.
    Is your VM running in VMWare on Windows?
    Are you using bridged networking?
    Can you ssh into it via putty from your desktop?

    Thanks

    Dave

    #40645

    Yes I am using bridged networking.

    VM is in virtual box.

    I tried telnet into the up and port no response.

    #40658
    Dave
    Moderator

    Hi Sawan,

    This will be something on your local machine / virtual box settings.
    Check firewalls etc until the telnet works on 8020 – as you have showed that it is listening.

    As this isn’t a HDP question and more of a OS issue there isn’t much I can do.

    Thanks

    Dave

    #40663

    What will I see when telnet works ? Will the telnet session reply something by default?

    #40688
    Dave
    Moderator

    Hi,

    When the telnet works, then it will present you with a near on black screen instead of connection refused.

    Thanks

    Dave

    #40692

    Yes, I got blank screen. It doesnot say connection refused – but also does not say connection accepted.

    2nd I tried creating ODBC connection and it works. But I am unable to connect to HDFS through Pentaho. Looks like Pentaho issue.

    Thanks,
    Sawan

    #40704
    Dave
    Moderator

    Hi Sawan,

    Then the telnet is working correctly, so you will need to follow up with Pentaho to see how you troubleshoot the connection with them.

    Thanks

    Dave

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.