Introduction - moulokenacademy

Azure Data Factory Introduction

Azure Data Factory

0% Completed

SECTION 1: INTRODUCTION

SECTION 2: ENVIRONMENT SETUP

Module Overview

Create Azure Account

Azure Portal Walkthrough

Create Storage Account

Create Azure DataLake Gen 2

Create Azure Data Factory

Create Azure SQL

Create Azure SQL Server VM (Virtual Machine)

SECTION 3: BUILDING BLOCKS OF ADF

Supported File Formats

Interaction Between Different Components

SECTION 4: COPY DATA ACTIVITY

Copy Data From Blob ADLS(Azure DataLake Storage)

Copy Data Logging Settings

Copy Data - Multiple Files From a Folder & Other Settings

Copy Data - Last Modified Filter

Copy Data SQL DB to ADLS

Copy Data Fault Tolerance

Setup Self Hosted IR(Integration Runtime)

Copy Data On Prem DB to ADLS

Delete SQL Server VM

Ingest Data From API to ADLS

SECTION 5: PARAMETERS AND VARIABLES

Parameterized Components

Variables in ADF

System Variables

Set Variable Activity

SECTION 6: CONTROL FLOW ACTIVITY

Filter Activity

ForEach Activity

LookUp Activity

Real World Scenario 2#

Get Meta Data Activity

Real World Scenario

If Condition Activity

The Wait Activity

The Switch Activity

Validation Activity

SECTION 7: OTHER IMPORTANT PIPELINE ACTIVITIES

Stored Procedure Activity

Real World Scenario

Delete Activity

Execute Pipeline

Dataflow Activity

SECTION 8: MAPPING DATAFLOWS

Mapping Dataflows

Source Transformation

Sink Transformation

Select Transformations

Filter Transformation

Exist Transformation

Sort Transformation

Rank Transformation

Aggregate Transformation

Join Transformation

Pivot Transformation

LookUp Transformation

Surrogate Key Transformation

Flatten Transformation

Alter Row Transformation

Asset Transformation

SECTION 9: ADVANCED CONCEPT

Expression & Function

Dynamic Queries

SECTION 10: TRIGGERS

Types of Trigger

Schedule Trigger

Storage Event Based Trigger

Tumbling Window Trigger

SECTION 11: MONITORING

Pipeline Monitoring

Announcements Reviews Course Info

Here is the course link: https://docs.google.com/document/d/19b7DgQrDpwLaPm-K_dAaHK9zGA9zODAq/edit