Get in Touch

Course Outline

Section 1: Data Management in HDFS

  • Various Data Formats (JSON, Avro, Parquet)
  • Compression Schemes
  • Data Masking
  • Labs: Analyzing different data formats; enabling compression

Section 2: Advanced Pig

  • User-defined Functions
  • Introduction to Pig Libraries (ElephantBird, Data-Fu)
  • Loading Complex Structured Data using Pig
  • Pig Tuning
  • Labs: advanced Pig scripting, parsing complex data types

Section 3: Advanced Hive

  • User-defined Functions
  • Compressed Tables
  • Hive Performance Tuning
  • Labs: creating compressed tables, evaluating table formats and configuration

Section 4: Advanced HBase

  • Advanced Schema Modelling
  • Compression
  • Bulk Data Ingest
  • Wide-table vs. Tall-table comparison
  • HBase and Pig
  • HBase and Hive
  • HBase Performance Tuning
  • Labs: tuning HBase; accessing HBase data from Pig & Hive; Using Phoenix for data modeling

Requirements

  • Proficiency in the Java programming language (as most programming exercises are conducted in Java)
  • Comfort in a Linux environment (ability to navigate the Linux command line and edit files using vi or nano)
  • Working knowledge of Hadoop.

Lab environment

Zero Install: Students do not need to install Hadoop software on their own machines! A functional Hadoop cluster will be provided for use.

Students will require the following

 21 Hours

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories