Home Forums HDP on Linux – Installation Adding additional disk space to existing data nodes

Tagged: 

This topic contains 10 replies, has 6 voices, and was last updated by  Yi Zhang 11 months ago.

  • Creator
    Topic
  • #25759

    P K
    Member

    I have created a new file system and trying to add it to existing HDFS by updating hdfs-site.xml – dfs-data-dir property on all data nodes. After restarting the HDFS and other components I don’t see size of HDFS increased. Also I try to perform same task using Ambari but the the option to update additional filesystem is greyed out. any ideas how it can be done ?

Viewing 10 replies - 1 through 10 (of 10 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #26091

    Yi Zhang
    Moderator

    Hi Chris,

    The latest as of this moment is 1.2.3.6, which allows more rooms for changes in configs through UI. Ambari api supports host level and cluster overrides. You basically create a newer version of the config.

    That being said, is the new filesystem a different filesystem format than the existing ones? What kind?

    Thanks,
    Yi

    Collapse
    #26086

    Chris Miller
    Member

    I know you have a newer version of Ambari out that we could upgrade to.

    Question is whether the Management API calls should be working in 1.2.2.5? When were they introduced?

    Chris

    Collapse
    #26062

    Larry Liu
    Moderator

    Hi, Chris, P K,

    We have newer version of Ambari which would allow you to make changes to hdfs-site.xml from ambari UI. Please go to following page to upgrade:

    http://hortonworks.com/download/

    Thanks
    Larry

    Collapse
    #26060

    Chris Miller
    Member

    FYI – I have Ambari 1.2.2.5 installed.

    Collapse
    #26059

    Chris Miller
    Member

    Is there a way to update this parameter via Ambari’s REST API?

    e.g.

    {
    “Clusters”: {
    “desired_config”: {
    “type”: “hdfs-site”,
    “tag”: “version1″,
    “properties”: {
    “dfs_data_dir” : “/data”,
    }
    }
    }

    However, I get the following error. Perhaps this method on the Ambari API was not implemented?

    Status Code: 500 Unable to parse json: org.codehaus.jackson.JsonParseException: Unexpected character (‘}’ (code 125)): was expecting double-quote to start field name at [Source: java.io.StringReader@44ffe3b2; line: 8, column: 8]

    Collapse
    #25959

    Jeff Sposetti
    Moderator

    Links to the latest HDP version that includes Ambari 1.2.3 can be found here:

    http://docs.hortonworks.com/

    There is a chapter on Upgrading Ambari in the “Automated Install (Ambari)” doc.

    Collapse
    #25932

    Seth Lyubich
    Keymaster

    Hi all,

    Ability to change configuration via Ambari is in Ambari 1.2.3. You can try to upgrade and try again.

    Hope this helps.

    Thanks,
    Seth

    Collapse
    #25828

    Chris Miller
    Member

    Same issue here. When modifying the hdfs-site.xml configs on the data nodes directly they get overwritten by what is in Ambari-Server. We’re using the Ambari Server that comes with HDP 1.2.2.

    Collapse
    #25827

    P K
    Member

    Hi Jeff, please see below.
    Thanks

    yum info ambari-server
    Loaded plugins: product-id, rhnplugin, security, subscription-manager
    This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
    This system is receiving updates from RHN Classic or RHN Satellite.
    Installed Packages
    Name : ambari-server
    Arch : noarch
    Version : 1.2.2.5
    Release : 1
    Size : 42 M
    Repo : installed
    From repo : Updates-ambari-1.x
    Summary : Ambari Server
    License : 2012, Apache Software Foundation
    Description : Maven Recipe: RPM Package.

    Available Packages
    Name : ambari-server
    Arch : noarch
    Version : 1.2.3.6
    Release : 1
    Size : 32 M
    Repo : Updates-ambari-1.x
    Summary : Ambari Server
    License : 2012, Apache Software Foundation
    Description : Maven Recipe: RPM Package.

    Collapse
    #25785

    Jeff Sposetti
    Moderator

    Hi,

    Which version of Ambari are you running? On your ambari server…

    yum info ambari-server

    - Jeff

    Collapse
Viewing 10 replies - 1 through 10 (of 10 total)