HDP on Linux – Installation Forum

historyserver fails to jara

  • #53856
    Jason Shive
    Participant

    Hello,

    New cluster. After installation all the services came up as expected. There were no errors. I rebooted the App Timeline Server to simulate a failure, now the app timeline service won’t start, ever.

    In the yarn-yarn-historyserver.log file I see:

    java.lang.UnsatisfiedLinkError: Could not load library. Reasons: [no leveldbjni64-1.8 in java.library.path, no leveldbjni-1.8 in java.library.path, no leveldbjni in java.library.path, /tmp/libleveldbni-64-1 … and so on

    I see the leveldbjni in the java path that is defined in the config files. But for some reason after the first restart of the services it seemingly can no longer be found.

    Anyone seen this? Have any ideas?

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #53950
    Dave
    Moderator

    Hi Jason,

    Is your Java library path really /tmp ?

    Thanks

    Dave

    #67293
    Harry H. Haller
    Participant

    Hi.

    I’m having the same issue. I’ve checked all the filesystem, and i can find the library:

    find / -iname “leveldbjn*jar”
    /usr/hdp/2.2.0.0-2041/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar
    /usr/hdp/2.2.0.0-2041/hadoop-yarn/lib/leveldbjni-all-1.8.jar
    /usr/hdp/2.2.0.0-2041/hadoop/client/leveldbjni-all.jar
    /usr/hdp/2.2.0.0-2041/hadoop/client/leveldbjni-all-1.8.jar

    But, the TimeLine server fails with the same error:
    15/02/16 14:07:50 INFO applicationhistoryservice.ApplicationHistoryServer: registered UNIX signal handlers for [TERM, HUP, INT]
    15/02/16 14:07:51 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
    15/02/16 14:07:51 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s).
    15/02/16 14:07:51 INFO impl.MetricsSystemImpl: ApplicationHistoryServer metrics system started
    15/02/16 14:07:51 FATAL applicationhistoryservice.ApplicationHistoryServer: Error starting ApplicationHistoryServer
    java.lang.UnsatisfiedLinkError: Could not load library. Reasons: [no leveldbjni64-1.8 in java.library.path, no leveldbjni-1.8 in java.library.path, no leveldbjni in java.library.path, /tmp/libleveldbjni-64-1-6808737154577847504.8: /tmp/libleveldbjni-64-1-6808737154577847504.8: failed to map segment from shared object: Operation not permitted]
    at org.fusesource.hawtjni.runtime.Library.doLoad(Library.java:182)
    at org.fusesource.hawtjni.runtime.Library.load(Library.java:140)
    at org.fusesource.leveldbjni.JniDBFactory.<clinit>(JniDBFactory.java:48)
    at org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore.serviceInit(LeveldbTimelineStore.java:202)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
    at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.serviceInit(ApplicationHistoryServer.java:99)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.launchAppHistoryServer(ApplicationHistoryServer.java:157)
    at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.main(ApplicationHistoryServer.java:167)
    15/02/16 14:07:51 INFO util.ExitUtil: Exiting with status -1
    15/02/16 14:07:51 INFO impl.MetricsSystemImpl: Stopping ApplicationHistoryServer metrics system…
    15/02/16 14:07:51 INFO impl.MetricsSystemImpl: ApplicationHistoryServer metrics system stopped.
    15/02/16 14:07:51 INFO impl.MetricsSystemImpl: ApplicationHistoryServer metrics system shutdown complete.
    15/02/16 14:07:51 INFO applicationhistoryservice.ApplicationHistoryServer: SHUTDOWN_MSG:
    Store

    Any help would be appreciated

    #68717
    Pallabi Chakraborty
    Participant

    Getting the same kind of error

    where can this be changed to pick from the correct folder

    #75471
    Joel Patterson
    Participant

    I’m seeing this as well. Anyone find a solution?

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.