Data Lifecycle Manager (DLM) is a DataPlane application that protects not only your data but also the security policies associated with it through replication. This application empowers system administrators to replicate HDFS and Hive data from on-premises cluster to cloud storage. Replication of the Hive database from a cluster with underlying HDFS to another cluster with cloud storage is supported. DLM protects Data-at-Rest (TDE) and Data-in-Motion (TLS) and provides support for multiple key management service (KMS) and encryption keys.
Data Lifecycle Manager
Safeguard critical data assets
DLM provides replication of HDFS and Hive data from on-premises cluster to cloud storage. DLM provides a web UI that administrators can use to create and manage replication and disaster recovery policies and jobs. Avoid unnecessarily copying renamed files and directories and protect the data against accidental or intentional modification to meet governance and disaster recovery (DR) requirements. DLM enables system administrators to:
Incrementally replicate Hive data and metadata
Replicate data between HDP clusters using HDFS snapshots
Provide support for data-at-rest (TDE) and data-in-motion (TLS) encryption
Prevent unauthorized access to data and supports segregation of duties
Configure the destination cluster to serve as the new source, if the source cluster becomes unavailable
Get visibility into cluster status and automate replication tasks for enhanced productivity
Quickly identify any issues or verify the health of the clusters, policies, or jobs in DLM. View the total number of clusters enabled for DLM, the number for which all or some of the services are running, and the number of clusters for which remaining disk capacity is less than 10%. DLM provides system administrators with the flexibility to:
Create policies based on business rules
Replicate data based on data sets, day and time, the frequency of job execution and bandwidth restrictions
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, Nifi Registry, HAWQ, Zeppelin, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.