HDP Developer: Windows

This course is designed for developers who create applications and analyze Big Data in Apache Hadoop on Windows using Pig and Hive. Topics include: Hadoop, YARN, the Hadoop Distributed File System (HDFS), MapReduce, Sqoop and theHiveODBC Driver

Duration

4 days

Prerequisites

Students should have programming experience, preferably with Visual Studio and SQL, as well as familiarity with the Windows Server operating system. No prior Hadoop knowledge is required.

Target Audience

Software developers who need to understand and develop applications for Hadoop 2.x on Windows.

Course Objectives

At the completion of the course students will be able to:

  • Describe Hadoop and Hadoop and YARN  
  • Describe the Hadoop ecosystem 
  • List Components & deployment options for HDP onWindows  
  • Describe the HDFS architecture
  • Use the Hadoop client to input data into HDFS 
  • Transfer data between Hadoop and Microsoft SQL Server
  • Describe the MapReduce and YARN architecture
  • Run a MapReduce job on YARN 
  • Write a Pig script 
  • Define advanced Pig relations 
  • Use Pig to apply structure to unstructured Big Data 
  • Invoke a Pig UserDefined Function 
  • Use Pig to organize and analyze Big Data 
  • Describe how Hive tables are defined and implemented 
  • Use Hive windowing functions 
  • Define and use Hive file formats 
  • Create Hive tables that use the ORC file format 
  • Use Hive to run SQLlike queries to perform data analysis 
  • Use Hive to join datasets 
  • Create ngrams and context ngrams using Hive 
  • Perform data analytics 
  • Use HCatalog with Pig and Hive 
  • Install and configure HiveODBC Driver for Windows 
  • Import data from Hadoop into Microsoft Excel 
  • Define a workflow using Oozie 

Resources

Upcoming Courses

See our Schedule