Hadoop and Azure HDInsight Online Course

Hadoop and Azure HDInsight Online Course

Apache Hadoop is a powerful framework for distributed processing of large datasets, enabling scalability from single servers to thousands of machines. With the growing demand for big data expertise, mastering Hadoop has become an essential skill. This course begins with an introduction to the Hadoop ecosystem and its three main building blocks, followed by an exploration of common challenges and how Azure HDInsight provides effective solutions. You’ll dive into cluster types, HDInsight architecture, and key components, gaining a clear understanding of real-world applications. Practical lessons guide you through fetching data from a data lake, processing it with Hive, and storing results in SQL Server.

By the end of the course, you’ll have both theoretical knowledge and hands-on skills to manage big data workflows efficiently using Hadoop and HDInsight.

Who should take this Course?

The Hadoop and Azure HDInsight Online Course is ideal for data engineers, big data developers, and IT professionals who want to process, analyze, and manage large datasets using Hadoop on the Azure cloud platform. It is also suitable for students, aspiring data scientists, and cloud practitioners seeking hands-on experience with distributed computing, big data analytics, and scalable data solutions using Azure HDInsight.

What you will learn

• Learn cluster types in Azure HDInsight
• Learn to store data in SQL server
• Learn to process data through Hive
• Explore HDInsight architectures of Azure HDInsight
• Create and add managed identity to Gen2
• Create resource group in Microsoft Azure

Course Outline 

Introduction

• Introduction

Introduction to Azure Cloud Computing

• Create Azure Free Subscription
• Azure Portal Overview
• Azure Services Overview
• Resource Management Group and Subscription
• Resource Groups
• Tagging
• Delete Resources and Set Budget

Introduction to Hadoop Overview

• Hadoop Overview
• Why We Need Distribute Computing?
• Two Ways to Build System
• Introducing Hadoop
• Hadoop versus RDBMS
• Hadoop Summary

Introduction to HDInsight

• Why Hadoop is Hard
• How HDInsight Make Hadoop Easy
• Important Aspects of HDInsight
• HDInsight Cluster Types
• HDInsight Architecture

HDInsight Demo

• Demo Overview
• Create Azure Data Lake Storage Gen 2 (Source) and SQL Server (Destination)
• What is Managed Identity
• Add Managed Identity to Gen2 and Database Accounts
• Create HDInsight Interactive Query Cluster
• Ambari Overview and UI
• Ingest dataset into Data Lake storage
• Data Extraction with Hive
• Data Transformation with Hive
• Data Export Using Sqoop
• Summary