HDP on Windows – Installation Forum

HADOOP FAILURE: Non-empty mapred.local.dir folders:

  • #46281
    David Vance
    Participant

    When I try to install HDP for Windows 1.3 on a Win 2008 R2 Enterprise 64 bit box, the following error is issued:

    HADOOP FAILURE: Non-empty mapred.local.dir folders:

    The ClusterProperties.txt contains:

    #Log directory
    HDP_LOG_DIR=e:\hadoop\logs

    #Data directory
    HDP_DATA_DIR=e:\hdp\data

    #Hosts
    NAMENODE_HOST=xx.xxx.xx.52
    SECONDARY_NAMENODE_HOST=xx.xxx.xx.52
    JOBTRACKER_HOST=xx.xxx.xx.52
    HIVE_SERVER_HOST=xx.xxx.xx.52
    OOZIE_SERVER_HOST=xx.xxx.xx.52
    WEBHCAT_HOST=xx.xxx.xx.52
    FLUME_HOSTS=xx.xxx.xx.53, xx.xxx.xx.54, xx.xxx.xx.55
    HBASE_MASTER=xx.xxx.xx.52
    HBASE_REGIONSERVERS=xx.xxx.xx.53, xx.xxx.xx.54, xx.xxx.xx.55
    ZOOKEEPER_HOSTS=xx.xxx.xx.53, xx.xxx.xx.54, xx.xxx.xx.55
    SLAVE_HOSTS=xx.xxx.xx.53, xx.xxx.xx.54, xx.xxx.xx.55

    #Database host
    DB_FLAVOR=derby
    DB_HOSTNAME=xx.xxx.xx.52

    #Hive properties
    HIVE_DB_NAME=hive
    HIVE_DB_USERNAME=hive
    HIVE_DB_PASSWORD=hive

    #Oozie properties
    OOZIE_DB_NAME=oozie
    OOZIE_DB_USERNAME=oozie
    OOZIE_DB_PASSWORD=oozie

    The command line is:
    msiexec /i “hdp-1.3.0.0.winpkg.msi” /lv “hdp-1.3.0.0-ga-install.log” HDP_LAYOUT=”D:\Download\HortonWorks\HDPForWindows\1.3\Extract\hdp-1.3.0.0-GA\clusterproperties.txt” HDP_DIR=”e:\hdpInstallDir” DESTROY_DATA”=”yes”

    How is the error solved?

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #46445
    David Vance
    Participant

    If anyone can provide any insight regarding this error, I would be very much appreciative!

    #46625
    David Vance
    Participant

    Well, I did a no-no and made several changes at once to try to fix it. One or more of the following eliminated the error.

    1. In the ClusterProperties files (listed above), I had 2 things going to the E drive. My install command also had the HDP_Dir parameter set to e:\hadoop. Changed it to d:\hadoop.

    2. In windows, turned-off the User Account Control settings.

    3. Deleted the folders from the previous attempts (hadoop, HadoopInstallFiles, hdp). (Although this would seem like the obvious solution, it did not work in isolation (without the other steps).

    4. Reboot.

    Hope these steps help someone with the same issue.

    #46741
    Seth Lyubich
    Moderator

    Hi David,

    Thanks for letting us know that you resolved the issue. I think step 3 is what did the trick, and I saw UAT causing issue with installation as well.

    Seth

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.