What you'll learn:
- Students will learn Advance Hive and Sqoop for Big Data Analytics and Ingestion.
You will start by learning what is Hadoop & Hadoop distributed file system and most common hadoop commands required to work with Hadoop File system
Then you will be introduced to Sqoop Import
Understand lifecycle of sqoop command.
Use sqoop import command to migrate data from Mysql to HDFS.
Use sqoop import command to migrate data from Mysql to Hive.
Use various file formats, compressions, file delimeter,where clause and queries while importing the data.
Understand split-by and boundary queries.
Use incremental mode to migrate the data from Mysql to HDFS.
Further, you will learn Sqoop Export to migrate data.
What is sqoop export
Using sqoop export, migrate data from HDFS to Mysql.
Using sqoop export, migrate data from Hive to Mysql.
Finally, we will start with Apache Hive [Advance]
Hive Intro
External &Managed Tables
Insert & Multi Insert
Data Types & Complex Data Types
Collection Function
Conditional Function
Hive String Functions
Hive Date Functions
Mathematical Function
Hive Analysis
Alter Command
Joins, Multi Joins &Map Joins
Working with Different Files - Parquet,Avro
Compressions
Partitioning
Bucketing
Views
Lateral Views/Explode
Windowing Functions - Rank/Dense Rank/lead/lag/min/max
Window Specification
