Home Forums Hortonworks Sandbox Unable to access HDFS from host

Tagged: ,

This topic contains 11 replies, has 2 voices, and was last updated by  Dave 11 months, 1 week ago.

  • Creator
    Topic
  • #40449

    Hi,

    I am trying to access HDFS from host using Pentaho.

    What port and userId should I use? Also do i have to set any exceptions in configuration for hdfs master node to accept connections?

    Sawan

Viewing 11 replies - 1 through 11 (of 11 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #40704

    Dave
    Moderator

    Hi Sawan,

    Then the telnet is working correctly, so you will need to follow up with Pentaho to see how you troubleshoot the connection with them.

    Thanks

    Dave

    Collapse
    #40692

    Yes, I got blank screen. It doesnot say connection refused – but also does not say connection accepted.

    2nd I tried creating ODBC connection and it works. But I am unable to connect to HDFS through Pentaho. Looks like Pentaho issue.

    Thanks,
    Sawan

    Collapse
    #40688

    Dave
    Moderator

    Hi,

    When the telnet works, then it will present you with a near on black screen instead of connection refused.

    Thanks

    Dave

    Collapse
    #40663

    What will I see when telnet works ? Will the telnet session reply something by default?

    Collapse
    #40658

    Dave
    Moderator

    Hi Sawan,

    This will be something on your local machine / virtual box settings.
    Check firewalls etc until the telnet works on 8020 – as you have showed that it is listening.

    As this isn’t a HDP question and more of a OS issue there isn’t much I can do.

    Thanks

    Dave

    Collapse
    #40645

    Yes I am using bridged networking.

    VM is in virtual box.

    I tried telnet into the up and port no response.

    Collapse
    #40618

    Dave
    Moderator

    Hi Sawan,

    So 192.1268.16.52 is listening on port 8020.
    Is your VM running in VMWare on Windows?
    Are you using bridged networking?
    Can you ssh into it via putty from your desktop?

    Thanks

    Dave

    Collapse
    #40598

    Hi Dave,

    Thanks for quick reply.

    I have taken the screenshot output of netstat – http://imgur.com/rXplyU4

    Thanks,
    Sawan

    Collapse
    #40586

    Dave
    Moderator

    Hi Sawan,

    Yes, run a ps -ef | grep NameNode
    Look for the process like 00:00:31 /usr/jdk64/jdk1.6.0_31/bin/java -Dproc_namenode

    Then do a netstat -anp | grep $PID from above

    It should be 8020, can you telnet to that port on the sandbox from your machine? You could try building a HDP cluster and running it on a static IP instead of localhost?

    Thanks

    Dave

    Collapse
    #40584

    Yes I did the same. I used the IP and port 8020 amd user as sandbox it is unable to connect.

    Is there a way to confirm the hdfs port using netstat?

    Collapse
    #40583

    Dave
    Moderator

    Hi Sawan,

    Having only read a bit about Pentaho, I would expect you connect it to your NameNode.
    As this is running on your host machine, you need to ensure you can connect to 127.0.0.1 on port 8020
    You would need to use the hdfs user, however this doesn’t have a password set, so you should set this in the sandbox when you log in as root.

    Thanks

    Dave

    Collapse
Viewing 11 replies - 1 through 11 (of 11 total)