Best Hadoop Training

Introduction to Big Data

Big Data relies on volume, velocity, and variety with respect to processing.

Data can be divided into three types—unstructured data, semi-structured data, and structured data.

Big Data technology understands and navigates big data sources, analyzes unstructured data, and ingests data at a high speed.

Introduction Apache Hadoop

Type of Data generation

Apache ecosystem & its projects

Hadoop distributors

HDFS core concepts

Modes of Hadoop employment

HDFS Flow architecture

HDFS MrV1 vs. MrV2 architecture

Yarn Architecture

Unix commands

Hadoop commands

Hands on exercises

Map Reduce

MapReduce Design flow

MapReduce Program (Job) execution

Types of Input formats & Output Formats

MapReduce Datatypes

Performance tuning of MapReduce jobs

Word-count program example explanation

Hands-on with word-count program

Apache Hive

Introduction to Hive

Hive features

Hive architecture flow

Hive vs Pig

HCatalog

Hive Limitations

Hive Data Types

Hive Complex Data Types

DML/DDL commands explanation

Hive data loading

Hive Functions

Hive Joins

Partitioning static & Dynamic logic

Bucketing logic

Skewed by logic

Hive File formats

Performance Techniques

Hive script execution in shell & HUE

Hive exercises

Hive hands-on

Apache Pig

Introduction to Pig concepts and Architecture

Pig Components

Pig Execution modes

Pig Latin Basics

Pig Data Flow

Pig Latin Concepts

Pig Commands

Pig Data Types

Pig Latin – Examples

Advanced Pig Programming concepts like COGROUP, pig UDF

Pig modes of execution

Pig script execution in shell/HUE

Pig hands-on

Apache HBase

Introduction to HBase concepts

Introduction to NoSQL/CAP theorem concepts

HBase design/architecture flow

Hbase table commands

HDFS vs Hbase

RDBMS vs Hbase

Hbase execution in shell/HUE

Hbase Example

Hands-on

Apache Sqoop

Introduction to Sqoop concepts

Sqoop internal design/architecture

Sqoop Import statements concepts

Sqoop Export Statements concepts

Quest Data connectors flow

Incremental updating concepts

Creating a database in MySQL for importing to HDFS

Sqoop commands execution in shell/HUE

Sqoop Examples

Sqoop Hands-on

Apache Flume

Introduction to Flume & features

Flume topology & core concepts

Property file parameters logic

Flume NetCat example & Spooldir example

Flume Hands-on

Impala

Impala Architecture

Creating tables in Impala

Accessing Hive Metastore

Hands on

Apache Spark

About Spark

Spark History

MapReduce and Spark

Spark – Layered Architecture

Spark – Cluster Architecture

Cluster Manager – Deployment Modes

About Scala

Word count example on Scala

Project

Using Hive & Power BI