Buy NOW!

$1,500.00

Overview

Join our Analyzing with Data Warehouse course, a four-day intensive program designed to equip you with the skills to apply traditional data analytics and business intelligence techniques to big data. You’ll learn to use tools essential for data professionals, enabling you to access, manipulate, transform, and analyze complex datasets using SQL and familiar scripting languages.

What You’ll Learn

Through instructor-led discussions and interactive, hands-on exercises, participants will navigate the ecosystem and learn to:

  • Use Apache Hive and Apache Impala to access data through queries.
  • Identify distinctions between Hive and Impala, including differences in syntax, data formats, and supported features.
  • Write and execute queries using functions, aggregate functions, and subqueries.
  • Utilize joins and unions to combine datasets.
  • Create, modify, and delete tables, views, and databases.
  • Load data into tables and store query results.
  • Select file formats and develop partitioning schemes for improved performance.
  • Use analytic and windowing functions to gain insights from your data.
  • Store and query complex or nested data structures.
  • Process and analyze semi-structured and unstructured data.
  • Optimize and extend the capabilities of Hive and Impala.
  • Determine the best choice for your tasks—Hive, Impala, an RDBMS, or a mix of these.
  • Utilize the benefits of the CDP Public Cloud Data Warehouse.

What to Expect

This course is designed for aspiring data analysts and professionals seeking to enhance their skills in big data analytics. Participants will gain practical experience through hands-on exercises, preparing them for real-world data challenges.

Course details

Foundations for Big Data Analytics

  • Big Data Analytics Overview
  • Data Storage: HDFS
  • Distributed Data Processing: YARN, MapReduce, and Spark
  • Data Processing and Analysis: Hive and Impala
  • Database Integration: Sqoop
  • Other Data Tools
  • Exercise Scenario Explanation

Introduction to Apache Hive and Impala

  • What Is Hive?
  • What Is Impala?
  • Why Use Hive and Impala?
  • Schema and Data Storage
  • Comparing Hive and Impala to Traditional Databases
  • Use Cases

Querying with Apache Hive and Impala

  • Databases and Tables
  • Basic Hive and Impala Query Language Syntax
  • Data Types
  • Using Hue to Execute Queries
  • Using Beeline (Hive’s Shell)
  • Using the Impala Shell

Common Operators and Built-In Functions

  • Operators
  • Scalar Functions
  • Aggregate Functions

Analyzing Text

  • Using Regular Expressions with Hive and Impala
  • Processing Text Data with SerDes in Hive
  • Sentiment Analysis and n-grams in Hive

Apache Hive Optimization

  • Understanding Query Performance
  • Cost-Based Optimization and Statistics
  • Bucketing
  • ORC File Optimizations

Apache Impala Optimization

  • How Impala Executes Queries
  • Improving Impala Performance

Extending Hive and Impala

  • User-Defined Functions
  • Parameterized Queries

Data Management

  • Data Storage
  • Creating Databases and Tables
  • Loading Data
  • Altering Databases and Tables
  • Simplifying Queries with Views
  • Storing Query Results

Data Storage and Performance

  • Partitioning Tables
  • Loading Data into Partitioned Tables
  • When to Use Partitioning
  • Choosing a File Format
  • Using Avro and Parquet File Formats

Working with Multiple Datasets

  • UNION and Joins
  • Handling NULL Values in Joins
  • Advanced Joins

Analytic Functions and Windowing

  • Using Analytic Functions
  • Other Analytic Functions
  • Sliding Windows

Complex Data

  • Complex Data with Hive
  • Complex Data with Impala

Choosing the Best Tool for the Job

  • Comparing Hive, Impala, and
  • Relational Databases
  • Which to Choose?

CDP Public Cloud Data Warehouse

  • Data Warehouse Overview
  • Auto-Scaling
  • Managing Virtual Warehouses
  • Querying Data Using CLI and Third-Party Integration

Appendix: Apache Kudu

  • What Is Kudu?
  • Kudu Tables
  • Using Impala with Kudu