Home Forums Hortonworks Sandbox Python script not generating log 12: How to Refine and Visualize Server Log Data

This topic contains 3 replies, has 3 voices, and was last updated by  Santosh Aditham 1 month, 2 weeks ago.

  • Creator
    Topic
  • #49145

    Mayank Rathi
    Participant

    Hello ,

    Python script generate_logs.py is not generating log files. When I tried to run the script command prompt did not return to normal. Any clues ?

    reduce/hadoop-streaming-2.2.0.2.0.6.0-76.jar:/usr/lib/hadoop-mapreduce/lib:/usr/lib/hadoop-mapreduce/sbin:/conf’ -Djava.library.path=::/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native::/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native org.apache.flume.node.Application -f /etc/flume/conf/flume.conf -n sandbox
    python generate_logs.py

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #62313

    Santosh Aditham
    Participant

    Update: Nothing wrong with the tutorial, just very very slow. If I stop the python script in 5 mins, I get approx 100 rows with HCatalog. If I leave the python script running for almost an hour, I get 500 rows with HCatalog. Sadly, the eventlog has 250,000+ rows!!! So either leave the python script for a day or two or try this: http://kzhendev.wordpress.com/2014/04/06/apache-flume-get-logs-out-of-rabbitmq-and-into-hdfs/

    Collapse
    #62302

    Santosh Aditham
    Participant

    Exact same issue. Tutorial says ” When the log file has been generated, a timestamp will appear, and the command prompt will return to normal ([root@Sandbox \~]\#). It may take several seconds to generate the log file.” but I do not see command prompt returning to NORMAL! Any help at all?

    Collapse
    #50039

    Sriraman S
    Participant

    Same here !! Python script generate_logs.py is not generating the log files!! Please help asap!!!

    Collapse
Viewing 3 replies - 1 through 3 (of 3 total)