How to use HDFS Explorer to manage files on the Hortonworks Sandbox

This tutorial is from the Community part of tutorial for Hortonworks Sandbox – a single-node Hadoop cluster running in a virtual machine. Download to run this and other tutorials in the series. The tutorial was validated with Sandbox 2.0

This community tutorial submitted by Redgate with source available at Github. Feel free to contribute edits or your own tutorial and help the community learn Hadoop.

Summary

This tutorial explains how to quickly browse, upload and download files to and from the Hortonworks sandbox from within Windows using HDFS Explorer. HDFS Explorer is a Free Windows Explorer based GUI file manager for the Hadoop Distributed File System (HDFS).

In this tutorial we will walk through how to connect HDFS Explorer to the Hortonworks Sandbox, and explain what familiar functionality you will then have access to.

Prerequisites

  1. Download and start Hortonworks Sandbox 2.0
  2. Download and install HDFS Explorer

Step one: Enable access to the Hortonworks Sandbox from your local machine.

In order to access the Hortonworks Sandbox with HDFS Explorer you will need to create an entry in your hosts file.

To do this launch Notepad with administrator privileges.

Alt text

In Notepad, click File > Open, paste the following into the file name field, and then click Open:

%systemroot%\system32\drivers\etc\hosts

Alt text
Add the following code to the end of the hosts file:

192.168.56.101 sandbox.hortonworks.com sandbox

Alt text

… and save the changes.

Note: if you have configured your Sandbox to use a different IP address, then you’ll need to change the IP address in the snippet above.

Step Two: Connect to your Sandbox in HDFS Explorer.

  • Launch HDFS Explorer
  • Add a new connection (File > Add Connection)
  • Enter the following credentials and click OK:
  • Cluster address: sandbox.hortonworks.com
  • User name: hadoop

Alt text

Alt text

**Note: HDFS Explorer supports multiple connections. To create additional connections, simply click file > add connection again. **

Next Steps

Once HDFS Explorer is connected to the Hortonworks Sandbox it can be used to rapidly upload files and data and download query results using the familiar Windows Explorer-like GUI.

HDFS Explorer supports common Windows Explorer functionality including:

  • Copying, moving, renaming and deleting files
  • Drag and drop
  • Fast navigation of folder structures
  • Support for multiple windows
  • Bookmarked locations

For additional documentation on HDFS Explorer, visit the HDFS Explorer website.

Comments

Hassan Mohamed
|
September 4, 2014 at 1:22 pm
|

I am following to tutorials on this link
http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/

at the point of how to use hdfs I was stuck and then guessed to download hdfs
I was able download and install hdfs explorer and upload nytsv.gz file but when i clicked to open this took me to file&folder Lite software I have on my pc to open the file in notepad! it is supposed to open a table in hdfs explorer.
then the next step was to us hdcatalog to create a table etc I do not any icon on hdfs explorer to accomplish this step

Leave a Reply

Your email address will not be published. Required fields are marked *

If you have specific technical questions, please post them in the Forums

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Try this tutorial with :

These tutorials are designed to work with Sandbox, a simple and easy to get started with Hadoop. Sandbox offers a full HDP environment that runs in a virtual machine.