File browser in HUE does not log certain HDFS activity

to create new topics or reply. | New User Registration

This topic contains 1 reply, has 2 voices, and was last updated by  Dave 1 year, 2 months ago.

  • Creator
    Topic
  • #46923

    Alessandro Cagnetti
    Participant

    Hi,

    I have setup HUE for users to log in and leverage the UI for Hive, Pig development and also browse the filesystem. For Security reasons I have activated full login on HDFS to INFO level (instead of default WARN). Any access with hadoop command line (create directory, upload file, delete file / dir etc…) is logged.
    However, I have noticed that HUE filebrowsing feature allows certain operations to HDFS that are not logged as they should be: deletion of a folder / file, creation of directories. The strange thing is that access to file is logged as it should be.

    Is there anything to do to enable logging of HDFS operations when using hue? I tought that logging in log4j enabled to INFO would log every single operation to HDFS…

    thank you

Viewing 1 replies (of 1 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #46926

    Dave
    Moderator

    Hi Alessandro,

    Let me look into this for you and I’ll get back to you.
    You may need to increase the logging for webhdfs

    Thanks

    Dave

    Collapse
Viewing 1 replies (of 1 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.