Get Started

Ready to Get Started?

Download sandbox

1.408.675.0983

Hortonworks Community

Get Answers

Score with Big Data

Get my score

Save with SmartSense

Calculate My Savings

How can we help you?

Apache Hadoop Data Warehouse Architecture for EDW Optimization

Reduce Costs by Moving Data and Processing to Hadoop^®

Hortonworks is a leader. Read the Forrester Wave.

DOWNLOAD Report

What is an EDW?
The Problem
Solution
Optimizing EDW
Use Cases
Resources

What is an EDW?

Enterprise Data Warehouse (EDW) is an organization’s central data repository that is built to support business decisions. EDW contains data related to areas that the company wants to analyze. For a manufacturer, it might be customer, product or bill of material data. EDW is built by extracting data from a number of operational systems. As the data is fed into EDW it is converted, reformatted and summarized to present a single corporate view. Data is added into the data warehouse over time in the form of snapshots and normally an enterprise data warehouse contains data spanning 5 to 10 years. A Hadoop data warehouse architecture enables deeper analytics and advanced reporting from these diverse sets of data.

Problems with a typical EDW

The Enterprise Data Warehouse has become a standard component of the corporate data architectures. However, the complexity and volume of data has posed some interesting challenges to the efficiency of existing EDW solutions.

Realizing the transformative potential of Big Data depends on the corporations’ ability to manage complexity while leveraging data sources of all types such as social, web, IoT and more. The integration of new data sources into the existing EDW system will empower corporations more and deeper analytics and insights. More importantly, EDW optimization using Hadoop provides a highly cost-efficient environment with optimal performance, scalability and flexibility.

Solution Elements

Hortonworks Data Platform

Powerful open Hadoop data warehouse architecture with capabilities for data governance and integration, data management, data access, security and operations—designed for deep integration with your existing data center technology. Learn More

Syncsort

EDW offload to Hadoop - High-performance ETL software to access and easily onboard traditional enterprise data to HDP. Learn More

JethroData

High performance analytical engine for interactive BI on Hadoop Big Data. Learn More

Professional Services

Expert guidance and support to quickly prove the value of your new architecture and maximize the value of the full tested and validated Hortonworks data architecture optimization solution. Learn More

EDW optimization with Apache Hadoop ^®

Flexible

Data can be loaded in HDP without having a data model in place

Data model can be applied based on the questions being asked of data (schema-on-read)

HDP is designed to answer questions as they occur to the user

Efficient

100% of the data is available at granular level for analysis

HDP can store and analyze both structured and unstructured data

Data can be analyzed in different ways to support diverse use cases

Cost Effective

HDP (Hortonworks Data Platform) is 100% open - there is no licensing fee for software

HDP runs on commodity hardware

New data can be landed in HDP and used in days or even hours

Use-Cases on EDW Optimization

USE-CASE 1

ONBOARD ETL PROCESSES TO HADOOP

A typical EDW spends between 45 to 65 percent of its CPU cycles on ETL processing.These lower-value ETL jobs compete for resources with more business-critical workloads and can cause SLA misses. Hadoop can EDW offload these ETL jobs with minimal porting effort and at substantially lower cost, saving money and freeing up capacity on your EDW for higher-value analytical workloads. Hortonworks makes it easy by providing high-performance ETL tools, a powerful SQL engine and integration with all major BI vendors.

Learn More

USE-CASE 2

ACTIVE ARCHIVE & ENRICHMENT IN HADOOP

Increasing data volumes and cost pressures force many companies to archive old data to tape where it can’t be analyzed or must be retrieved at great expense.

A Hadoop data warehouse architecture offers cost per terabyte on par with tape backup solutions. Because of the appealing cost, you can store years of data rather than months. All of your enterprise data remains available for retrieval, query and deep analytics with the same tools you use on existing EDW systems.

Learn More

USE-CASE 3

Interactive BI on Hadoop

Proprietary EDW systems were adopted for fast BI and deep slice-and-dice analytics, but EDW prices are unsustainably high and these systems have not adapted to modern big data challenges like unstructured data and large-scale analytics.

Hortonworks and JethroData makes fast BI on Hadoop a reality, with the combination of a fast in-memory SQL engine to create data marts with a high performance analytical engine for interactive BI that lets you support 1,000’s of concurrent users and query huge datasets in seconds. JethroData dynamically will create indexes and cubes, lowering the upfront setup cost and time. Standard access to all your Hadoop data is supported with your existing BI tools like Tableau, Qlik or Microstrategy.

Learn More

Featured Resources

blog

10.12.17

You have a legacy system that no longer meet the demands of your current data needs, and replacing it isn’t an option. But don’t panic: Modernizing your traditional enterprise data...

learn more

READY TO GET STARTED?

1 855 8-HORTON

CONTACT FORM

DOWNLOAD HDP^®

Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, Nifi Registry, HAWQ, Zeppelin, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.

Get fresh updates from Hortonworks by email

Sign up for the Developers Newsletter

How can we help you?

Apache Hadoop Data Warehouse Architecture for EDW Optimization

Reduce Costs by Moving Data and Processing to Hadoop®

What is an EDW?

Problems with a typical EDW

Solution Elements

Hortonworks Data Platform

Syncsort

JethroData

Professional Services

EDW optimization with Apache Hadoop ®

Flexible

Efficient

Cost Effective

Use-Cases on EDW Optimization

ONBOARD ETL PROCESSES TO HADOOP

ACTIVE ARCHIVE & ENRICHMENT IN HADOOP

Interactive BI on Hadoop

Featured Resources

How Customers are Optimizing their EDW...

Businesses are striving to get the most value out of their data and turn it into actionable insights. The shift towards becoming a data-centric organization requires a modern data architecture...

IBM and Hortonworks Partnership Highlighted at...

Hortonworks and IBM’s partnership has brought multiple joint solutions for Global Data Management to the market. From HDP on Power Systems and Spectrum Scale Storage which provides customers fast access...

From EDW Optimization to Business Transformation

If I asked a question about the benefits in optimizing Enterprise Data Warehouse (EDW) with Apache Hadoop, from my own experience, 9 out of 10 responses had to do with...

HDFS Tiering with Isilon and ECS...

Guest post by Boni Bruno. Originally published for the Dell EMC Community. Many organizations use traditional, direct attached storage (DAS) Hadoop clusters for storing big data. As data requirements grow,...

Modernizing Your Data Architecture – Webinar...

Recently I had the opportunity to participate in a joint webinar with Mark McKinney, Director Enterprise Analytics at Sprint and Sanjay Vyas, CEO and founder of Diyotta. During the webinar,...

Modernize your Existing EDW with IBM...

New Solutions Enable EDW Optimization Modernizing your existing enterprise data warehouse may require offloading workloads from RDBMSs like Oracle, Db2, and IBM PureData Systems for Analytics (Netezza) into Apache Hadoop...

The Next-Generation EDW Is The Big...

EDW is not dead; it’s evolving! Enterprise data warehouses have come a long way in delivering value by predicting trends, minimizing churn, and identifying new business opportunities. However, in the era...

Total Economic Impact Study

This could be the most valuable actionable intelligence you ever see. Sometimes it’s good to get back to the basics. The day-to-day queries, data ingestion and analysis, and allocation of...

Big SQL: SQL on Apache Hadoop...

Guest author Nagapriya Tiruthani, Offering Manager, IBM Big SQL, IBM Why Big SQL? Enterprise Data Warehousing (EDW) emerged as a logical home for all enterprise data that captures the essence of...

Accelerating Big Data Insights with Dell...

Hadoop’s data analytics capabilities offer tremendous potential for deriving new and differentiated business insights. But, many organizations get bogged down with the DIY infrastructure decisions and fail to keep up...

Exploring the Heated—and Completely Unnecessary—Data Lake...

EDW Optimization Requires Combined Solution Enterprise data lake vs. data warehouse… which is better? There’s no need for heated debate. Data lakes actually complement the data warehouse and are an...

Using Big Data & Hive 2...

Big Wins in a Short Time with HDP & Hive 2 with LLAP Geisinger Health System is well known in the healthcare community as a pioneer in data and analytics....

Enterprise Data Warehouse Optimization: 7 Keys...

You have a legacy system that no longer meet the demands of your current data needs, and replacing it isn’t an option. But don’t panic: Modernizing your traditional enterprise data...

SQL and Hadoop Query Performance Smackdown

LLAP wins the fastest execution among the SQL engines! Comcast is one of the nation's leading providers of communications, entertainment and cable products and services. Headquartered in Philadelphia, PA, they...

TDWI Checklist Report

You have a legacy system that no longer meet the demands of your current data needs, and replacing it isn’t an option. But don’t panic: Modernizing your traditional enterprise data...

READY TO GET STARTED?

Reduce Costs by Moving Data and Processing to Hadoop^®

EDW optimization with Apache Hadoop ^®