Azure Data Factory Classroom Training

This impeccable Azure Data Factory Training course is carefully designed for aspiring ETL Developers and Architects. This Azure Data Factory Training includes basic to advanced ETL Concepts, Data Warehouse (DWH) and Data Mashups / Data Flow concepts using SQL Server, Azure SaaS Components. This Azure Data Factory Training course also includes Azure SQL Database Migrations, Azure Storage, Azure Data Warehouse (ADW), Incremental Loads, Power Query, Azure Data Lake required for Big Data Analytics and Warehouse design with ONE Real-time Project.

Azure Data Factory Training Plans

	PLAN A	PLAN B	PLAN C
	Azure DataFactory & Syanpse	Power BI Azure DataFactory	Power BI, Azure Data Engineer
Total Duration	2 Weeks	6 Weeks	10 Weeks
ADF : Azure Data Factory	✔	✔	✔
ADF : Data Imports, ETL	✔	✔	✔
ADF : Data Flows, Wrangling	✔	✔	✔
ADF : Transformations, ETL	✔	✔	✔
Synapse: Configuration, Loads	✔	✔	✔
Synapse: ETL with ADF, DWH	✔	✔	✔
Synapse: Performance Tuning	✔	✔	✔
Synapse: MPP, cDWH, DIUs	✔	✔	✔
Power BI: Report Design, Visuals	❌	✔	✔
Power BI: M Lang, DX for ETL	❌	✔	✔
Power BI: Report Server, Admin	❌	✔	✔
ADB : Azure Data Bricks	❌	❌	✔
ADB : Architecture, Data Loads	❌	❌	✔
ADB : Run Spark Jobs, Pools	❌	❌	✔
ADB : Workspace, Delta Tables	❌	❌	✔
Cosmos : Configurations	❌	❌	✔
Cosmos: Distribute Data, ETL	❌	❌	✔
Cosmos: Integration with ADF	❌	❌	✔
Cosmos: Structured Streaming	❌	❌	✔
Total Course Fee *	INR 9,000 USD 122	INR 17,000 USD 230	INR 31,000 USD 419

Trainer: Mr. Sai Phanindra T

If above schedule does not work, opt for Azure Synapse Training Videos

Azure Data Factory Training Highlights :

✔ Azure Data Factory

✔ Azure Databricks

✔ Azure Synapse

✔ Azure Cosmos DB

✔ ADF Resources, Monitor

✔ Power Query in ADF

✔ Azure Storage Explorer

✔ Azure Data Explorer

✔ On-Premise Migrations

✔ Big Data Storage

✔ Performance Tuning

✔ Security Management

✔ Prepping, Ingestions

✔ Spark Clusters, Python, Scala

All Session Are Completely Practical & Real Time

Azure Data factory Training Course Contents:

Curriculum

Register Today

Azure Data Factory Training Content

1. Azure Fundamentals: What is Cloud? Advantages of Azure Cloud? IaaS, SaaS & PaaS. Azure Data Engineer Technologies, Job Roles. DP 200, 201 Exams Azure Account Registration and Free Trail Activation; Understanding Azure Resources and Resource Types; Creating Resource Groups in Azure Portal;
2. Azure SQL Server: Azure Resources; Resource Groups; Azure SQL Server [Logical Server] Creation; Server Name Format and Firewall Rules; Azure Services Access with Firewall; Test Connections with SSMS Tool and Azure Data Studio Tool; Creating Azure SQL Databases in Portal, T-SQL; Tables, Data Inserts;
3. Azure SQL DB Migrations: Azure SQL DB Migrations from OnPremise; Using Data Migration Assistant Tool; Migration Assessments; Deploy Schema & Migrate Data Options; Onpremise Versus Azure SQL DB Differences; Generating bacpac Files From SSMS Tool; Azure SQL DB Exports & Imports;

Module 1	Module 2	Module 3
Ch 1: Azure Data Factory, Synapse Intro Azure Data Factory (ADF) Operations Hybrid Data Ingestion, Orchestration Data Processing & Movement in ADF Data Pipelines, Flows & Wrangling Data Mashup and ETL in Azure Azure Synapse (Data Warehouse) Enterprise Warehouse with Synapse Azure Synapse (SQL Pools) Creation DWUs: Data Warehouse Units Usage Big Data Storage and Data Analytics Column Store Data in Azure Synapse Automated Tuning and Security Access, Pause/Resume with Synapse SSMS & ADS Tools Connections	Ch 4: Azure Data Lake with ADF Creating Azure Data Lake Storage Data Lake Gen 2 Hierarchial Namespace Excel Upload to Container, Data Preview Pipeline Parameters, Variables, OUT Copy Data Tool: Timeout and Schedule Secured Pipelines and Linked Services Sink Options; Colum Mapping, Triggers Azure SQL Database Loads to Synapse Azure SQL Database Tables Data Loads For Each Loops with ADF Pipelines Copy Data Tool, Pipeline Edits in ADF Task Schedules and Tumbling Window Pipeline Execution & Runs; Monitor	Ch 7: Incremental Loads with ADF - 2 Incremental Load Pipeline Design in ADF Working with Azure Storage Containers Pipeline Executions, Incremental Schedules Regular Schedules & Tumbiling Windows Binay Copy, Last Modified Date in Blob Pipeline Trigger Schedules, Modifications Incompatable Rows Skips, Fault Tolerance Incremental Loads with Mutliple Tables Stored Procedures, Loops in ADF Pipelines Configure ETL Sources, Pre-Copy Scripts Using @{item() with Dyanamic Connections Table_Schema for Column Mapping Writing Expressions For Dynamic Loads Staging and Performance for ADF Loads
Ch 2: Azure Synapse Architecture MPP - Massively Parallel Processsing Control Node and Compute Nodes Azure Storage, DMS and DWUs Round Robin, Replicate, Hash Tables Service Level Objective, Sharding Resource Classes; Gen 1 and Gen 2; Table Creation, Storage, Distribution CTAS: Create Table As Select. Indexes Distribution Types, Time Partitions Logins and Users in SQL Server Users and Roles in Synapse SQL DW Resource Classes; Blob Data Import COPY INTO Statement in T-SQL Data Monitoring Scripts with T-SQL	Ch 5: On-Premise Data to Azure On-Premise Data Sources with Azure Install Self Hosted Integration Runtime Access Keys & Use. Configuration Tools Remote Linked Services in ADF & SH IR Authentication with Integration Runtime Sourc, Sink Linked Service Connections Incompatable Rows Skip, Fault Tolerance Table Mapping, Column Mapping, Errors Synapse Pool Connection with Onpremise Staged Data Copy & ETL Performance Azure Blob for Staging. Polybase Connections Management - Preview Pipeline Exectution, Run IDs, Errors	Ch 8: Mapping Data Flow in ADF Data Flow Task Creation in ADF Pipelines Transformation Editor and Parameters Comparing ADF Pipelines and Data Flow Debugging: ADF Managed Executions Apache Spark Clusters @ ADF Debugging Authoring Data Flow, Graph, Configuration Transformation Setting, Optimize, Inspect Conditional Split Transformation in ADF Pivot Transformation in Mapping Data Flow Pivot Column & Aggregation Functions Pivot Transformation, Pivot Settings Pivot Key Value, Enabling Null Values Pivoted Columns, Pattern, Optimize Column Prefix, Help Graphic, Metadata
Ch 3: Azure Data Factory Architecture ADF Pipeline Design, Publish, Trigger ADF Architecture, Pipelines & ETL DIU : Data Integration Units; Concurrency Linked Service, Dataset & Activities Staging Data - Advantages and Pricing Polybase Indexes, Compression Options Mapping Data Flow, Wrangling Data Flow Pipeline Creation using Copy Data Tool Azure BLOB Storage to Synapse DB Linked Service and Datasets. Mapping Polybase; Staging, Bulk Import Options Validate, Publish Pipelines to ADF Store Pipeline Execution (Triggers), Monitoring Auto Resolving Integration Runtime (IR)	Ch 6: Incremental Loads with ADF - 1 ADF Pipelines with Stored Procedures Watermark Tables and Timestamp Columns Incremental Data Loads to Azure DW New Rows and Old Rows Indentifications Storing High Water Mark Data Stored Procedures for Timestamp Updates Azure Storage Container Incremental Loads Lookup in ADF Portal & ModifiedDate Expressions in ADF Portal for Lookup Expressions in ADF Portal for Source @activity with output Data Pipelines SQL Queries for Dataset Creation Concat Function, Run IDs For File Names ADF Pipeline Validation and Triggers	Ch 9: Wrangling Data Flow in ADF Wrangling Data Flow in ADF : Advantages Power Query Online Editor for Mashup Spark Code for Cloud Scale Executions Wrangling Data For Less Formal Analytics Sources and Sinks with Wrangling DF Github Integration with ADF Repository User Defined Data Stores in GitHub Transformations in Data Wrangling Group By, Aggregate, Reordering Pivot, Aggregations in Power Query ADF Data Types & ADF Pipeline Store Heterogenous Sources in Power Query ADF Publish, GitHub Store Differences
Ch 10: ADF : End to End Implementation Azure Data Share: Configuration & Use; Azure Data Share: PaaS for ADF Shares; Importing BACPAC Files into Azure; Azure SQL DB: Data Lake Storage Gen 2; Data Filters, Aggregations, Joins in ADF; Spark Clusters for DataFlow Debugging; Multi Leve Data Flows in ADF Pipeline Data Loads to Azure Synapse from ADLS; Data Load Settings and Optimization; ADF Pipeline Debugging, Publish in ADF; Data Shares with Azure Synapse Tables; Data Ingestion, Consumption with Synapse; Recipients and Azure AD Users, Accounts; Run IDs, Monitoring, Cost Analysis, Metrics

Module 1

Module 2

Module 3

Ch 1: Azure Data Factory, Synapse Intro

Azure Data Factory (ADF) Operations
Hybrid Data Ingestion, Orchestration
Data Processing & Movement in ADF
Data Pipelines, Flows & Wrangling
Data Mashup and ETL in Azure
Azure Synapse (Data Warehouse)
Enterprise Warehouse with Synapse

Azure Synapse (SQL Pools) Creation
DWUs: Data Warehouse Units Usage
Big Data Storage and Data Analytics
Column Store Data in Azure Synapse
Automated Tuning and Security
Access, Pause/Resume with Synapse
SSMS & ADS Tools Connections

Ch 4: Azure Data Lake with ADF

Creating Azure Data Lake Storage
Data Lake Gen 2 Hierarchial Namespace
Excel Upload to Container, Data Preview
Pipeline Parameters, Variables, OUT
Copy Data Tool: Timeout and Schedule
Secured Pipelines and Linked Services
Sink Options; Colum Mapping, Triggers

Azure SQL Database Loads to Synapse
Azure SQL Database Tables Data Loads
For Each Loops with ADF Pipelines
Copy Data Tool, Pipeline Edits in ADF
Task Schedules and Tumbling Window
Pipeline Execution & Runs; Monitor

Ch 7: Incremental Loads with ADF - 2

Incremental Load Pipeline Design in ADF
Working with Azure Storage Containers
Pipeline Executions, Incremental Schedules
Regular Schedules & Tumbiling Windows
Binay Copy, Last Modified Date in Blob
Pipeline Trigger Schedules, Modifications
Incompatable Rows Skips, Fault Tolerance

Incremental Loads with Mutliple Tables
Stored Procedures, Loops in ADF Pipelines
Configure ETL Sources, Pre-Copy Scripts
Using @{item() with Dyanamic Connections
Table_Schema for Column Mapping
Writing Expressions For Dynamic Loads
Staging and Performance for ADF Loads

Ch 2: Azure Synapse Architecture

MPP - Massively Parallel Processsing
Control Node and Compute Nodes
Azure Storage, DMS and DWUs
Round Robin, Replicate, Hash Tables
Service Level Objective, Sharding
Resource Classes; Gen 1 and Gen 2;
Table Creation, Storage, Distribution

CTAS: Create Table As Select. Indexes
Distribution Types, Time Partitions
Logins and Users in SQL Server
Users and Roles in Synapse SQL DW
Resource Classes; Blob Data Import
COPY INTO Statement in T-SQL
Data Monitoring Scripts with T-SQL

Ch 5: On-Premise Data to Azure

On-Premise Data Sources with Azure
Install Self Hosted Integration Runtime
Access Keys & Use. Configuration Tools
Remote Linked Services in ADF & SH IR
Authentication with Integration Runtime
Sourc, Sink Linked Service Connections
Incompatable Rows Skip, Fault Tolerance

Table Mapping, Column Mapping, Errors
Synapse Pool Connection with Onpremise
Staged Data Copy & ETL Performance
Azure Blob for Staging. Polybase
Connections Management - Preview
Pipeline Exectution, Run IDs, Errors

Ch 8: Mapping Data Flow in ADF

Data Flow Task Creation in ADF Pipelines
Transformation Editor and Parameters
Comparing ADF Pipelines and Data Flow
Debugging: ADF Managed Executions
Apache Spark Clusters @ ADF Debugging
Authoring Data Flow, Graph, Configuration
Transformation Setting, Optimize, Inspect

Conditional Split Transformation in ADF
Pivot Transformation in Mapping Data Flow
Pivot Column & Aggregation Functions
Pivot Transformation, Pivot Settings
Pivot Key Value, Enabling Null Values
Pivoted Columns, Pattern, Optimize
Column Prefix, Help Graphic, Metadata

Ch 3: Azure Data Factory Architecture

ADF Pipeline Design, Publish, Trigger
ADF Architecture, Pipelines & ETL
DIU : Data Integration Units; Concurrency
Linked Service, Dataset & Activities
Staging Data - Advantages and Pricing
Polybase Indexes, Compression Options
Mapping Data Flow, Wrangling Data Flow

Pipeline Creation using Copy Data Tool
Azure BLOB Storage to Synapse DB
Linked Service and Datasets. Mapping
Polybase; Staging, Bulk Import Options
Validate, Publish Pipelines to ADF Store
Pipeline Execution (Triggers), Monitoring
Auto Resolving Integration Runtime (IR)

Ch 6: Incremental Loads with ADF - 1

ADF Pipelines with Stored Procedures
Watermark Tables and Timestamp Columns
Incremental Data Loads to Azure DW
New Rows and Old Rows Indentifications
Storing High Water Mark Data
Stored Procedures for Timestamp Updates
Azure Storage Container Incremental Loads

Lookup in ADF Portal & ModifiedDate
Expressions in ADF Portal for Lookup
Expressions in ADF Portal for Source
@activity with output Data Pipelines
SQL Queries for Dataset Creation
Concat Function, Run IDs For File Names
ADF Pipeline Validation and Triggers

Ch 9: Wrangling Data Flow in ADF

Wrangling Data Flow in ADF : Advantages
Power Query Online Editor for Mashup
Spark Code for Cloud Scale Executions
Wrangling Data For Less Formal Analytics
Sources and Sinks with Wrangling DF
Github Integration with ADF Repository
User Defined Data Stores in GitHub

Transformations in Data Wrangling
Group By, Aggregate, Reordering
Pivot, Aggregations in Power Query
ADF Data Types & ADF Pipeline Store
Heterogenous Sources in Power Query
ADF Publish, GitHub Store Differences

Ch 10: ADF : End to End Implementation

Azure Data Share: Configuration & Use; Azure Data Share: PaaS for ADF Shares; Importing BACPAC Files into Azure; Azure SQL DB: Data Lake Storage Gen 2; Data Filters, Aggregations, Joins in ADF; Spark Clusters for DataFlow Debugging; Multi Leve Data Flows in ADF Pipeline

Data Loads to Azure Synapse from ADLS; Data Load Settings and Optimization; ADF Pipeline Debugging, Publish in ADF; Data Shares with Azure Synapse Tables; Data Ingestion, Consumption with Synapse; Recipients and Azure AD Users, Accounts; Run IDs, Monitoring, Cost Analysis, Metrics

Azure Data Engineer Training Content

1. Azure Fundamentals: What is Cloud? Advantages of Azure Cloud? IaaS, SaaS & PaaS. Azure Data Engineer Technologies, Job Roles. DP 200, 201 Exams Azure Account Registration and Free Trail Activation; Understanding Azure Resources and Resource Types; Creating Resource Groups in Azure Portal;
2. Azure SQL Server: Azure Resources; Resource Groups; Azure SQL Server [Logical Server] Creation; Server Name Format and Firewall Rules; Azure Services Access with Firewall; Test Connections with SSMS Tool and Azure Data Studio Tool; Creating Azure SQL Databases in Portal, T-SQL; Tables, Data Inserts;
3. Azure SQL DB Migrations: Azure SQL DB Migrations from OnPremise; Using Data Migration Assistant Tool; Migration Assessments; Deploy Schema & Migrate Data Options; Onpremise Versus Azure SQL DB Differences; Generating bacpac Files From SSMS Tool; Azure SQL DB Exports & Imports;

Mod 1: Azure Data Factory, Azure Synapse, Azure Data Share, Azure Key Vaults	Mod 2: Azure Storage, Azure Data Lake Storage, Azure Data Lake Analytics, U-SQL	Mod 3: Azure Databricks, Azure Cosmos DB, Azure Stream Analytics, NoSQL
Ch 1: Azure Data Factory, Synapse Intro Azure Data Factory (ADF) Operations Hybrid Data Ingestion, Orchestration Data Processing & Movement in ADF Data Pipelines, Flows & Wrangling Data Mashup and ETL in Azure Azure Synapse (Data Warehouse) Enterprise Warehouse with Synapse Azure Synapse (SQL Pools) Creation DWUs: Data Warehouse Units Usage Big Data Storage and Data Analytics Column Store Data in Azure Synapse Automated Tuning and Security Access, Pause/Resume with Synapse SSMS & ADS Tools Connections	Ch 11: Azure Storage Concepts Azure Storage Managed Service & Use Azure Storage Services and Types High Availability, Durability, Scalability Blob: Binary Large Object Storage General Purpose : Gen 1 and Gen 2 Blobs, File Share, Queues and Tables Data Lake Gen 2 with Azure Storage Blob - File System and Object Storage Queues: Message Store, Secured Access File Share - SMB [Server Message Block] Azure Tables - Unstructured Data Store Block Blob, Append Blob and Page Blobs HTTP & HTTPS Access to Azure Services Azure Storage Containers, End Points	Ch 21: Azure Databricks Configurations Azure Databricks: Spark Based Analytics ADB Workspace, Data Science Analytics Workspace Options, Databricks Runtime Serverless Storage, ETL and Analytics Databricks File System (DBFS) Store Notebooks: SQL, Spark, Python, Scala Apache Spark Eco System & Integrations Azure Databricks Deployment Options Databricks Units (DBU) & Workspace Network Security Group and Storage Databricks Clusters: Architecture Standard & High Concurrency Clusters Databricks Pools, Capacity: CPU, Memory Autopilot Options; Worker & Driver Nodes
Ch 2: Azure Synapse Architecture MPP - Massively Parallel Processsing Control Node and Compute Nodes Azure Storage, DMS and DWUs Round Robin, Replicate, Hash Tables Service Level Objective, Sharding Resource Classes; Gen 1 and Gen 2; Table Creation, Storage, Distribution CTAS: Create Table As Select. Indexes Distribution Types, Time Partitions Logins and Users in SQL Server Users and Roles in Synapse SQL DW Resource Classes; Blob Data Import COPY INTO Statement in T-SQL Data Monitoring Scripts with T-SQL	Ch 12: Azure Tables & Azure BLOB Azure Tables - Real-time Use, NoSQL Schema-less Design and Access Options Structured and Realtional Data Storage Tables, Entities and Properties Concepts Azure Storage Account for Table Store Azure Tables in Portal - GUI, Data Types Azure Tables using Storage Explorer Tool Query Azure Tables @ Query Builder Data Imports From Excel, CSV Files BLOB Data Imports @ T-SQL Queries SAS: Shared Access Signature CSV Uploads, Downloads, Edits, Keys Master Key Credentials, External Sources BULK INSERT Statement, Data Imports	Ch 22: Databricks Notebooks, Spark Jobs Databricks Workspace and Spark Clusters FileStore and Tables. Notebook Options Data File Uploads an Tables to DBFS Notebook Creation, Cells, Cmd Executions Python Notebooks, ETL, Data Access Data Frames Creation, Access, Analytics Reports, Graphs, Plot and Custom UI Spark Jobs with Azure Open Datasets Notebooks For Azure BLOB Data Access Remote Data @ Spark Jobs in Notebooks Parquet Files and Data Frames with Spark Select Queries on Temporary Data Views Bar Chart and Custom Reports, Analytics ADB Plots: Aggregation and Display Type
Ch 3: Azure Data Factory Architecture ADF Pipeline Design, Publish, Trigger ADF Architecture, Pipelines & ETL DIU : Data Integration Units; Concurrency Linked Service, Dataset & Activities Staging Data - Advantages and Pricing Polybase Indexes, Compression Options Mapping Data Flow, Wrangling Data Flow Pipeline Creation using Copy Data Tool Azure BLOB Storage to Synapse DB Linked Service and Datasets. Mapping Polybase; Staging, Bulk Import Options Validate, Publish Pipelines to ADF Store Pipeline Execution (Triggers), Monitoring Auto Resolving Integration Runtime (IR)	Ch 13: Azure Files, Queues & Security Azure Files - SMB Protocol, Creation Shared Access, Fully Managed, Resilency Performance, Size Requirements for Shares Azure Storage Explorer Tool for File Access Azure Queues and Message Queues Adding Messages, Queing and De-Queing Clear Queue and Messages from Explorer Azure Storage Security - Storage Keys Shared Access - Primary, Secondary Keys SAS: Shared Access Signature Generation Encryption and Data Security at REST CORS (Cross Origin Resource Sharing) Auditing Access, Network Access Rules Firewall, Advanced Threat Protection	Ch 23: Python Notebooks & Operations Databricks Notebooks, Cells and Usage Execution & Idle Contexts and Evictions Azure Databricks Notebooks Tasks Cluster Configuration Metadata Reads Notebook Schedules, Cloning, URL Path Notebook Exports and Imports; Re-use Cluster Configurations with Notebooks Python Notebooks and Magic Commands CSV Files to DBFS. Access using Python JDBC Hosts, Connection String, Access SQL Contexts & SQL DB Connections Data Imports with pyspark Assemblies Pandas Data frames in Python Notebooks Tables and Data Imports using Notebooks
Ch 4: Azure Data Lake with ADF Creating Azure Data Lake Storage Data Lake Gen 2 Hierarchial Namespace Excel Upload to Container, Data Preview Pipeline Parameters, Variables, OUT Copy Data Tool: Timeout and Schedule Secured Pipelines and Linked Services Sink Options; Colum Mapping, Triggers Azure SQL Database Loads to Synapse Azure SQL Database Tables Data Loads For Each Loops with ADF Pipelines Copy Data Tool, Pipeline Edits in ADF Task Schedules and Tumbling Window Pipeline Execution & Runs; Monitor	Ch 14: Azure Monitor, KQL, Power Shell Azure Monitor Components for Storage Metrics and Logs with Azure Storage Monitoring the Azure Storage Namespaces Adding KQL Metrics; Account, Blob and File Ingress & Egress Chart; Average Latency Request Breakdowns, Signal Logic Options Alerts, Conditions, Notifications and Emails Power Shell Commands for Azure Storage PowerShell Remoting: Scripts and cmdlets Background Jobs, Transactions & Eventing Network Transfer & Power Shell Types $ # Prefix, Resource Groups in Power Shell Creating Storage Account, Context & Files	Ch 24: Scala Notebooks, SQL Notebooks Scala Notebooks and Big Data Loads CSV Files from Databricks File System Data Source Connections with Spark Driver Classes and SQL Server Drivers Data Frames in Spark, Reading Data Display, Transformations with Spark Data Loads to Azure SQL Synapse SQL Notebooks & Data Frame, Access Python Magic Comands for Data Access Data Frame View, Testing data.take(n) SQL Context for Data Representations SQL in Notebooks: SELECT, WHERE ORDER BY, GROUP BY, TOP, LIMIT
Ch 5: On-Premise Data to Azure On-Premise Data Sources with Azure Install Self Hosted Integration Runtime Access Keys & Use. Configuration Tools Remote Linked Services in ADF & SH IR Authentication with Integration Runtime Sourc, Sink Linked Service Connections Incompatable Rows Skip, Fault Tolerance Table Mapping, Column Mapping, Errors Synapse Pool Connection with Onpremise Staged Data Copy & ETL Performance Azure Blob for Staging. Polybase Connections Management - Preview Pipeline Exectution, Run IDs, Errors	Ch 15: Azure Stream Analytics, Event Hubs Azure Stream Analytics Pattern, Realations Ingest & Analyse; Stream Analytics Jobs IoT Hub, IoT Devices; Transformations IoT, Stream Analytics Jobs Monitoring Stream Analytics Jobs: Edits, Security Streaming Units, Error Handling Test Result, Output Schema in Hubs IoT Hubs, IoT Events: Azure SQL DB Azure Stream Analytics Integration Event Hub Policies, Consumer Groups Power BI Reports from Azure Storage Shared Access Signature with Power BI Data Visualizations with Azure Storage	Ch 25: Databricks Jobs & Power BI Databricks Jobs: Creation and Usage Job, Workspace & Concurrency Limits Notebooks with and without Parameters Jobs with Default Parameter Execution Interactive and Automated Clusters Job Schedules & Manual Executions Active Jobs and Monitoring with ADB Databricks with Power BI Desktop Spark Connectors in Power BI Access Token from Azure Databricks Spark Cluster Connection: Nodes, Pools Server Host Name, Ports and HTTP Power BI Reports with Databricks
Ch 6: Incremental Loads with ADF - 1 ADF Pipelines with Stored Procedures Watermark Tables and Timestamp Columns Incremental Data Loads to Azure DW New Rows and Old Rows Indentifications Storing High Water Mark Data Stored Procedures for Timestamp Updates Azure Storage Container Incremental Loads Lookup in ADF Portal & ModifiedDate Expressions in ADF Portal for Lookup Expressions in ADF Portal for Source @activity with output Data Pipelines SQL Queries for Dataset Creation Concat Function, Run IDs For File Names ADF Pipeline Validation and Triggers	Ch 16: Azure Data Lake Storage (ADLS) Azure Data Lake Storage - Data Store LIVE Edits, Permissions & Sharing Hadoop based on Apache YARN HDFS File System , Map Reduce Authentication & Access Control Azure Data Lake Gen 1 - Deployment Encryption with Service Master Key ADLS - Pricing and Instance Details Data Explorer Tool in Azure Portal Azure Strorage Explorer Tool File Preview and Header Row Promotion Download / Rename / Access Properties Folder Upload & Download; Quick Access Cached File Access, Folder Statistics	Ch 26: Azure Cosmos DB - Architecture Azure Cosmos DB: Gloabally Distributed Multi Model Support for Big Data Turnkey Global Distribution in Cosmos Always-On, Elastic Scalability, Low Pricing SQL API, Mongo DB, Cassandra, Gremlin Table API: Real-time Applicative Uses Azure Cosmos DB and Database Concept Containers - Collection, Table & Graph Items - Document, Rows, Node and Edge Azure Cosmos DB Accounts in Portal Azure Cosmos DB with Data Explorer Creating Containers & JSON Documents Data Store and Data Access (Querying) Scaling Options for Cosmos DB & Cautions
Ch 7: Incremental Loads with ADF - 2 Incremental Load Pipeline Design in ADF Working with Azure Storage Containers Pipeline Executions, Incremental Schedules Regular Schedules & Tumbiling Windows Binay Copy, Last Modified Date in Blob Pipeline Trigger Schedules, Modifications Incompatable Rows Skips, Fault Tolerance Incremental Loads with Mutliple Tables Stored Procedures, Loops in ADF Pipelines Configure ETL Sources, Pre-Copy Scripts Using @{item() with Dyanamic Connections Table_Schema for Column Mapping Writing Expressions For Dynamic Loads Staging and Performance for ADF Loads	Ch 17: ADLS Monitoring, Alerts Azure Data Lake Monitoring and Alerts ADL Metrics, Storage Utilization Reports Reads & Writes Metrics; Charts, Metrics Data Reads, Writes, Requests - Storage Report Shares, Download to Excel, Alerts Scope, Conditions and Action Groups Email Notifications and Scope Options ADLS - Security Management and Levels ADLS Resource Levels, Folder / File Leve IP Address; Role Based Access (RBAC) Access Control Lists (ACL), IAM AD Roles POSIX - Access ACLs and Default ACLs ACL Permissions; Read, Write,; Execute Super User, RWX, Owning Users, Groups	Ch 27: Azure Cosmos DB Queries Level 1 Hierarchial JSON Documents in Cosmos Embrace SQL, Extend SQL with NoSQL Writing, Adding and Importing JSON NoSQL Query Concepts and Executions SELECT Format and Query Items Request Charge, Results and IO Reads Writes, Index, Lokup and Roundtrip JSON Document & Key Value Pairs Data Storage, Query: WHERE, SET FROM, Aliases, Geo Spatial Queries JSON Scripts to Access Sub Documents Hierarchial Data, Parent-Child Relations NoSQL: Unary and Binary Operators SELECT with IN, BETWEEN, TOP, JOIN
Ch 8: Mapping Data Flow in ADF Data Flow Task Creation in ADF Pipelines Transformation Editor and Parameters Comparing ADF Pipelines and Data Flow Debugging: ADF Managed Executions Apache Spark Clusters @ ADF Debugging Authoring Data Flow, Graph, Configuration Transformation Setting, Optimize, Inspect Conditional Split Transformation in ADF Pivot Transformation in Mapping Data Flow Pivot Column & Aggregation Functions Pivot Transformation, Pivot Settings Pivot Key Value, Enabling Null Values Pivoted Columns, Pattern, Optimize Column Prefix, Help Graphic, Metadata	Ch 18: Azure Key Vaults & ADL Analytics Azure Passwords, Keys and Certificates Azure Key Vaults - Name and Vault URI Inbuilt Managed Key, Azure Key Vault Standard & Premium Azure Key Vaults Identify Vault Name, URI: Access Points Secret Page, Key Backups & Restores Adding Keys to Azure Vaults, Types Azure Data Lake Analytics Creation Dynamic Scaling, U-SQL Implementation Azure Data Lake Storage for Data Lake Jobs Creation, Execution Environment Distibuted Runtime Environment in ADLA ADLA - On-demand Job Service in Azure Exabyte Scale and Data Lake in USQL	Ch 28: Azure Cosmos DB Queries Level 2 Data Import Tool: Installation, Usage JSON Data Imports to Azure Cosmos DB Azure Cosmos Endpoints, Access Keys NoSQL Queries on JSON Documents Writing Stored Procedures & Functions ACID Properties : Atomocity, Consistency Isolation, Durability with Procedures SP Coding, Execution with Parameter Stored Procedures for Document Uploads Procedures with Variables, getResponse() Procedure Advantages, Execution Option User Defined Functions (UDF) in Cosmos UDF Execution using Cosmos DB Scripts Dynamic Calculation & Reporting Options
Ch 9: Wrangling Data Flow in ADF Wrangling Data Flow in ADF : Advantages Power Query Online Editor for Mashup Spark Code for Cloud Scale Executions Wrangling Data For Less Formal Analytics Sources and Sinks with Wrangling DF Github Integration with ADF Repository User Defined Data Stores in GitHub Transformations in Data Wrangling Group By, Aggregate, Reordering Pivot, Aggregations in Power Query ADF Data Types & ADF Pipeline Store Heterogenous Sources in Power Query ADF Publish, GitHub Store Differences	Ch 19: Data Lake Analytics, U-SQL 1 Azure Data Lake Analytics : Advantages USQL - Big Data Processing Language Azure Portal and Visual Studio Access Aggregate, Analytical, Ranking Functions U-SQL Catalog : Databases and Objects Rowsets, Types and USQL Expressions Azure U-SQL Jobs For Data Insertions U-SQL Jobs for Storage, Retreival SELECT, EXTRACT & OUTPUT Clauses USING, Outputters, Extractors Classes Script Execution, Job Graph, Diagnosis AU Allocation, Analysis for Job Execution Script Reuse. CSC, User & System Errors	Ch 29: Azure Notebooks, Azure Functions Azure Notebooks, Serverles Deployment Azure Cosmos Notebooks, Advantages Jupyter Notebook: Implementation, Usage Pandas DataFrame with Python Scripts Understanding Notebook and Cells Python Script for Azure Cosmos DB Python Script for Data Import & Report Azure Functions: Creation and Apps Azure Functions @ Cosmos DB Triggers Azure Function App Service Plans Serverless Components, Azure Insight Azure Cosmos DB Monitoring, Logs Azure Monitor Workbooks, Timelines
Ch 10: ADF : End to End Implementation Azure Data Share: Configuration & Use Azure Data Share: PaaS for ADF Shares Importing BACPAC Files into Azure Azure SQL DB: Data Lake Storage Gen 2 Data Filters, Aggregations, Joins in ADF Spark Clusters for DataFlow Debugging Multi Leve Data Flows in ADF Pipeline Data Loads to Azure Synapse from ADLS Data Load Settings and Optimization ADF Pipeline Debugging, Publish in ADF Data Shares with Azure Synapse Tables Data Ingestion, Consumption with Synapse Recipients and Azure AD Users, Accounts Run IDs, Monitoring, Cost Analysis, Metrics	Ch 20: Data Lake Analytics, U-SQL 2 U - SQL Operations with Visual Studio Script.usql, Executions & Job Graphs ADLA Account & Local Job Executions Metadata, State History & AU Analysis Working with TSV Data Sources in ADLS Extract, Format, Data Loads with U-SQL Adding New Columns to Files with U-SQL ADLA Jobs For Create Databases, Tables ADLA Managed Tables & External Tables Create Tables from Query Rowset Option Clone & Copy Tables using U-SQL Jobs Hash Distributed Tables, Clustered Index TVF - Table Valued Functions, Retreival SELECT, TOP, FETCH & ROW_NUMBER	Ch 30: Azure Cosmos Admin, Power BI Azure Cosmos DB: Conistency Levels Bounded Staleness and Consistent Prefix Eventual & Synchronizations with Cosmos Azure Cosmos: Backup Retention, Restores IAM: Identity Access Management, Azure AD Owner Role, Contributor & Reader Roles Cosmos Backup Operator, Account Reader Global Distribution Strategies, BCDR Data Replication and High Availability Multi Region Writes and Data Access Azure Cosmos Database Cost Calculations Availability Zones, Automated Failvoer Azure Cosmos Database Management Workloads and Multi Region Writes
Real-time Project @ Ecommerce Domain: Includes On-Premise Migrations with bac Files, Azure Storage Compoments, Azure Data Ingestions using Azure Data Factory; Big Data Storage with Azure Synapse and Azure Cosmos Database; Big Data Analytics using Azure Databricks and Azure Stream Analytics. This Real-time Project also includes End User Reporting with Power BI. Additionally includes Resume Support and DP 200, DP 201 Certification Guidance.

Mod 1: Azure Data Factory, Azure Synapse, Azure Data Share, Azure Key Vaults

Mod 2: Azure Storage, Azure Data Lake Storage, Azure Data Lake Analytics, U-SQL

Mod 3: Azure Databricks, Azure Cosmos DB, Azure Stream Analytics, NoSQL

Ch 1: Azure Data Factory, Synapse Intro

Azure Data Factory (ADF) Operations
Hybrid Data Ingestion, Orchestration
Data Processing & Movement in ADF
Data Pipelines, Flows & Wrangling
Data Mashup and ETL in Azure
Azure Synapse (Data Warehouse)
Enterprise Warehouse with Synapse

Azure Synapse (SQL Pools) Creation
DWUs: Data Warehouse Units Usage
Big Data Storage and Data Analytics
Column Store Data in Azure Synapse
Automated Tuning and Security
Access, Pause/Resume with Synapse
SSMS & ADS Tools Connections

Ch 11: Azure Storage Concepts

Azure Storage Managed Service & Use
Azure Storage Services and Types
High Availability, Durability, Scalability
Blob: Binary Large Object Storage
General Purpose : Gen 1 and Gen 2
Blobs, File Share, Queues and Tables
Data Lake Gen 2 with Azure Storage

Blob - File System and Object Storage
Queues: Message Store, Secured Access
File Share - SMB [Server Message Block]
Azure Tables - Unstructured Data Store
Block Blob, Append Blob and Page Blobs
HTTP & HTTPS Access to Azure Services
Azure Storage Containers, End Points

Ch 21: Azure Databricks Configurations

Azure Databricks: Spark Based Analytics
ADB Workspace, Data Science Analytics
Workspace Options, Databricks Runtime
Serverless Storage, ETL and Analytics
Databricks File System (DBFS) Store
Notebooks: SQL, Spark, Python, Scala
Apache Spark Eco System & Integrations

Azure Databricks Deployment Options
Databricks Units (DBU) & Workspace
Network Security Group and Storage
Databricks Clusters: Architecture
Standard & High Concurrency Clusters
Databricks Pools, Capacity: CPU, Memory
Autopilot Options; Worker & Driver Nodes

Ch 2: Azure Synapse Architecture

MPP - Massively Parallel Processsing
Control Node and Compute Nodes
Azure Storage, DMS and DWUs
Round Robin, Replicate, Hash Tables
Service Level Objective, Sharding
Resource Classes; Gen 1 and Gen 2;
Table Creation, Storage, Distribution

CTAS: Create Table As Select. Indexes
Distribution Types, Time Partitions
Logins and Users in SQL Server
Users and Roles in Synapse SQL DW
Resource Classes; Blob Data Import
COPY INTO Statement in T-SQL
Data Monitoring Scripts with T-SQL

Ch 12: Azure Tables & Azure BLOB

Azure Tables - Real-time Use, NoSQL
Schema-less Design and Access Options
Structured and Realtional Data Storage
Tables, Entities and Properties Concepts
Azure Storage Account for Table Store
Azure Tables in Portal - GUI, Data Types
Azure Tables using Storage Explorer Tool

Query Azure Tables @ Query Builder
Data Imports From Excel, CSV Files
BLOB Data Imports @ T-SQL Queries
SAS: Shared Access Signature
CSV Uploads, Downloads, Edits, Keys
Master Key Credentials, External Sources
BULK INSERT Statement, Data Imports

Ch 22: Databricks Notebooks, Spark Jobs

Databricks Workspace and Spark Clusters
FileStore and Tables. Notebook Options
Data File Uploads an Tables to DBFS
Notebook Creation, Cells, Cmd Executions
Python Notebooks, ETL, Data Access
Data Frames Creation, Access, Analytics
Reports, Graphs, Plot and Custom UI

Spark Jobs with Azure Open Datasets
Notebooks For Azure BLOB Data Access
Remote Data @ Spark Jobs in Notebooks
Parquet Files and Data Frames with Spark
Select Queries on Temporary Data Views
Bar Chart and Custom Reports, Analytics
ADB Plots: Aggregation and Display Type

Ch 3: Azure Data Factory Architecture

ADF Pipeline Design, Publish, Trigger
ADF Architecture, Pipelines & ETL
DIU : Data Integration Units; Concurrency
Linked Service, Dataset & Activities
Staging Data - Advantages and Pricing
Polybase Indexes, Compression Options
Mapping Data Flow, Wrangling Data Flow

Pipeline Creation using Copy Data Tool
Azure BLOB Storage to Synapse DB
Linked Service and Datasets. Mapping
Polybase; Staging, Bulk Import Options
Validate, Publish Pipelines to ADF Store
Pipeline Execution (Triggers), Monitoring
Auto Resolving Integration Runtime (IR)

Ch 13: Azure Files, Queues & Security

Azure Files - SMB Protocol, Creation
Shared Access, Fully Managed, Resilency
Performance, Size Requirements for Shares
Azure Storage Explorer Tool for File Access
Azure Queues and Message Queues
Adding Messages, Queing and De-Queing
Clear Queue and Messages from Explorer

Azure Storage Security - Storage Keys
Shared Access - Primary, Secondary Keys
SAS: Shared Access Signature Generation
Encryption and Data Security at REST
CORS (Cross Origin Resource Sharing)
Auditing Access, Network Access Rules
Firewall, Advanced Threat Protection

Ch 23: Python Notebooks & Operations

Databricks Notebooks, Cells and Usage
Execution & Idle Contexts and Evictions
Azure Databricks Notebooks Tasks
Cluster Configuration Metadata Reads
Notebook Schedules, Cloning, URL Path
Notebook Exports and Imports; Re-use
Cluster Configurations with Notebooks

Python Notebooks and Magic Commands
CSV Files to DBFS. Access using Python
JDBC Hosts, Connection String, Access
SQL Contexts & SQL DB Connections
Data Imports with pyspark Assemblies
Pandas Data frames in Python Notebooks
Tables and Data Imports using Notebooks

Ch 4: Azure Data Lake with ADF

Creating Azure Data Lake Storage
Data Lake Gen 2 Hierarchial Namespace
Excel Upload to Container, Data Preview
Pipeline Parameters, Variables, OUT
Copy Data Tool: Timeout and Schedule
Secured Pipelines and Linked Services
Sink Options; Colum Mapping, Triggers

Azure SQL Database Loads to Synapse
Azure SQL Database Tables Data Loads
For Each Loops with ADF Pipelines
Copy Data Tool, Pipeline Edits in ADF
Task Schedules and Tumbling Window
Pipeline Execution & Runs; Monitor

Ch 14: Azure Monitor, KQL, Power Shell

Azure Monitor Components for Storage
Metrics and Logs with Azure Storage
Monitoring the Azure Storage Namespaces
Adding KQL Metrics; Account, Blob and File
Ingress & Egress Chart; Average Latency
Request Breakdowns, Signal Logic Options
Alerts, Conditions, Notifications and Emails

Power Shell Commands for Azure Storage
PowerShell Remoting: Scripts and cmdlets
Background Jobs, Transactions & Eventing
Network Transfer & Power Shell Types
$ # Prefix, Resource Groups in Power Shell
Creating Storage Account, Context & Files

Ch 24: Scala Notebooks, SQL Notebooks

Scala Notebooks and Big Data Loads
CSV Files from Databricks File System
Data Source Connections with Spark
Driver Classes and SQL Server Drivers
Data Frames in Spark, Reading Data
Display, Transformations with Spark
Data Loads to Azure SQL Synapse

SQL Notebooks & Data Frame, Access
Python Magic Comands for Data Access
Data Frame View, Testing data.take(n)
SQL Context for Data Representations
SQL in Notebooks: SELECT, WHERE
ORDER BY, GROUP BY, TOP, LIMIT

Ch 5: On-Premise Data to Azure

On-Premise Data Sources with Azure
Install Self Hosted Integration Runtime
Access Keys & Use. Configuration Tools
Remote Linked Services in ADF & SH IR
Authentication with Integration Runtime
Sourc, Sink Linked Service Connections
Incompatable Rows Skip, Fault Tolerance

Table Mapping, Column Mapping, Errors
Synapse Pool Connection with Onpremise
Staged Data Copy & ETL Performance
Azure Blob for Staging. Polybase
Connections Management - Preview
Pipeline Exectution, Run IDs, Errors

Ch 15: Azure Stream Analytics, Event Hubs

Azure Stream Analytics Pattern, Realations
Ingest & Analyse; Stream Analytics Jobs
IoT Hub, IoT Devices; Transformations
IoT, Stream Analytics Jobs Monitoring
Stream Analytics Jobs: Edits, Security
Streaming Units, Error Handling
Test Result, Output Schema in Hubs

IoT Hubs, IoT Events: Azure SQL DB
Azure Stream Analytics Integration
Event Hub Policies, Consumer Groups
Power BI Reports from Azure Storage
Shared Access Signature with Power BI
Data Visualizations with Azure Storage

Ch 25: Databricks Jobs & Power BI

Databricks Jobs: Creation and Usage
Job, Workspace & Concurrency Limits
Notebooks with and without Parameters
Jobs with Default Parameter Execution
Interactive and Automated Clusters
Job Schedules & Manual Executions
Active Jobs and Monitoring with ADB

Databricks with Power BI Desktop
Spark Connectors in Power BI
Access Token from Azure Databricks
Spark Cluster Connection: Nodes, Pools
Server Host Name, Ports and HTTP
Power BI Reports with Databricks

Ch 6: Incremental Loads with ADF - 1

ADF Pipelines with Stored Procedures
Watermark Tables and Timestamp Columns
Incremental Data Loads to Azure DW
New Rows and Old Rows Indentifications
Storing High Water Mark Data
Stored Procedures for Timestamp Updates
Azure Storage Container Incremental Loads

Lookup in ADF Portal & ModifiedDate
Expressions in ADF Portal for Lookup
Expressions in ADF Portal for Source
@activity with output Data Pipelines
SQL Queries for Dataset Creation
Concat Function, Run IDs For File Names
ADF Pipeline Validation and Triggers

Ch 16: Azure Data Lake Storage (ADLS)

Azure Data Lake Storage - Data Store
LIVE Edits, Permissions & Sharing
Hadoop based on Apache YARN
HDFS File System , Map Reduce
Authentication & Access Control
Azure Data Lake Gen 1 - Deployment
Encryption with Service Master Key

ADLS - Pricing and Instance Details
Data Explorer Tool in Azure Portal
Azure Strorage Explorer Tool
File Preview and Header Row Promotion
Download / Rename / Access Properties
Folder Upload & Download; Quick Access
Cached File Access, Folder Statistics

Ch 26: Azure Cosmos DB - Architecture

Azure Cosmos DB: Gloabally Distributed
Multi Model Support for Big Data
Turnkey Global Distribution in Cosmos
Always-On, Elastic Scalability, Low Pricing
SQL API, Mongo DB, Cassandra, Gremlin
Table API: Real-time Applicative Uses
Azure Cosmos DB and Database Concept

Containers - Collection, Table & Graph
Items - Document, Rows, Node and Edge
Azure Cosmos DB Accounts in Portal
Azure Cosmos DB with Data Explorer
Creating Containers & JSON Documents
Data Store and Data Access (Querying)
Scaling Options for Cosmos DB & Cautions

Ch 7: Incremental Loads with ADF - 2

Incremental Load Pipeline Design in ADF
Working with Azure Storage Containers
Pipeline Executions, Incremental Schedules
Regular Schedules & Tumbiling Windows
Binay Copy, Last Modified Date in Blob
Pipeline Trigger Schedules, Modifications
Incompatable Rows Skips, Fault Tolerance

Incremental Loads with Mutliple Tables
Stored Procedures, Loops in ADF Pipelines
Configure ETL Sources, Pre-Copy Scripts
Using @{item() with Dyanamic Connections
Table_Schema for Column Mapping
Writing Expressions For Dynamic Loads
Staging and Performance for ADF Loads

Ch 17: ADLS Monitoring, Alerts

Azure Data Lake Monitoring and Alerts
ADL Metrics, Storage Utilization Reports
Reads & Writes Metrics; Charts, Metrics
Data Reads, Writes, Requests - Storage
Report Shares, Download to Excel, Alerts
Scope, Conditions and Action Groups
Email Notifications and Scope Options

ADLS - Security Management and Levels
ADLS Resource Levels, Folder / File Leve
IP Address; Role Based Access (RBAC)
Access Control Lists (ACL), IAM AD Roles
POSIX - Access ACLs and Default ACLs
ACL Permissions; Read, Write,; Execute
Super User, RWX, Owning Users, Groups

Ch 27: Azure Cosmos DB Queries Level 1

Hierarchial JSON Documents in Cosmos
Embrace SQL, Extend SQL with NoSQL
Writing, Adding and Importing JSON
NoSQL Query Concepts and Executions
SELECT Format and Query Items
Request Charge, Results and IO Reads
Writes, Index, Lokup and Roundtrip

JSON Document & Key Value Pairs
Data Storage, Query: WHERE, SET
FROM, Aliases, Geo Spatial Queries
JSON Scripts to Access Sub Documents
Hierarchial Data, Parent-Child Relations
NoSQL: Unary and Binary Operators
SELECT with IN, BETWEEN, TOP, JOIN

Ch 8: Mapping Data Flow in ADF

Data Flow Task Creation in ADF Pipelines
Transformation Editor and Parameters
Comparing ADF Pipelines and Data Flow
Debugging: ADF Managed Executions
Apache Spark Clusters @ ADF Debugging
Authoring Data Flow, Graph, Configuration
Transformation Setting, Optimize, Inspect

Conditional Split Transformation in ADF
Pivot Transformation in Mapping Data Flow
Pivot Column & Aggregation Functions
Pivot Transformation, Pivot Settings
Pivot Key Value, Enabling Null Values
Pivoted Columns, Pattern, Optimize
Column Prefix, Help Graphic, Metadata

Ch 18: Azure Key Vaults & ADL Analytics

Azure Passwords, Keys and Certificates
Azure Key Vaults - Name and Vault URI
Inbuilt Managed Key, Azure Key Vault
Standard & Premium Azure Key Vaults
Identify Vault Name, URI: Access Points
Secret Page, Key Backups & Restores
Adding Keys to Azure Vaults, Types

Azure Data Lake Analytics Creation
Dynamic Scaling, U-SQL Implementation
Azure Data Lake Storage for Data Lake
Jobs Creation, Execution Environment
Distibuted Runtime Environment in ADLA
ADLA - On-demand Job Service in Azure
Exabyte Scale and Data Lake in USQL

Ch 28: Azure Cosmos DB Queries Level 2

Data Import Tool: Installation, Usage
JSON Data Imports to Azure Cosmos DB
Azure Cosmos Endpoints, Access Keys
NoSQL Queries on JSON Documents
Writing Stored Procedures & Functions
ACID Properties : Atomocity, Consistency
Isolation, Durability with Procedures

SP Coding, Execution with Parameter
Stored Procedures for Document Uploads
Procedures with Variables, getResponse()
Procedure Advantages, Execution Option
User Defined Functions (UDF) in Cosmos
UDF Execution using Cosmos DB Scripts
Dynamic Calculation & Reporting Options

Ch 9: Wrangling Data Flow in ADF

Wrangling Data Flow in ADF : Advantages
Power Query Online Editor for Mashup
Spark Code for Cloud Scale Executions
Wrangling Data For Less Formal Analytics
Sources and Sinks with Wrangling DF
Github Integration with ADF Repository
User Defined Data Stores in GitHub

Transformations in Data Wrangling
Group By, Aggregate, Reordering
Pivot, Aggregations in Power Query
ADF Data Types & ADF Pipeline Store
Heterogenous Sources in Power Query
ADF Publish, GitHub Store Differences

Ch 19: Data Lake Analytics, U-SQL 1

Azure Data Lake Analytics : Advantages
USQL - Big Data Processing Language
Azure Portal and Visual Studio Access
Aggregate, Analytical, Ranking Functions
U-SQL Catalog : Databases and Objects
Rowsets, Types and USQL Expressions
Azure U-SQL Jobs For Data Insertions

U-SQL Jobs for Storage, Retreival
SELECT, EXTRACT & OUTPUT Clauses
USING, Outputters, Extractors Classes
Script Execution, Job Graph, Diagnosis
AU Allocation, Analysis for Job Execution
Script Reuse. CSC, User & System Errors

Ch 29: Azure Notebooks, Azure Functions

Azure Notebooks, Serverles Deployment
Azure Cosmos Notebooks, Advantages
Jupyter Notebook: Implementation, Usage
Pandas DataFrame with Python Scripts
Understanding Notebook and Cells
Python Script for Azure Cosmos DB
Python Script for Data Import & Report

Azure Functions: Creation and Apps
Azure Functions @ Cosmos DB Triggers
Azure Function App Service Plans
Serverless Components, Azure Insight
Azure Cosmos DB Monitoring, Logs
Azure Monitor Workbooks, Timelines

Ch 10: ADF : End to End Implementation

Azure Data Share: Configuration & Use
Azure Data Share: PaaS for ADF Shares
Importing BACPAC Files into Azure
Azure SQL DB: Data Lake Storage Gen 2
Data Filters, Aggregations, Joins in ADF
Spark Clusters for DataFlow Debugging
Multi Leve Data Flows in ADF Pipeline

Data Loads to Azure Synapse from ADLS
Data Load Settings and Optimization
ADF Pipeline Debugging, Publish in ADF
Data Shares with Azure Synapse Tables
Data Ingestion, Consumption with Synapse
Recipients and Azure AD Users, Accounts
Run IDs, Monitoring, Cost Analysis, Metrics

Ch 20: Data Lake Analytics, U-SQL 2

U - SQL Operations with Visual Studio
Script.usql, Executions & Job Graphs
ADLA Account & Local Job Executions
Metadata, State History & AU Analysis
Working with TSV Data Sources in ADLS
Extract, Format, Data Loads with U-SQL
Adding New Columns to Files with U-SQL

ADLA Jobs For Create Databases, Tables
ADLA Managed Tables & External Tables
Create Tables from Query Rowset Option
Clone & Copy Tables using U-SQL Jobs
Hash Distributed Tables, Clustered Index
TVF - Table Valued Functions, Retreival
SELECT, TOP, FETCH & ROW_NUMBER

Ch 30: Azure Cosmos Admin, Power BI

Azure Cosmos DB: Conistency Levels
Bounded Staleness and Consistent Prefix
Eventual & Synchronizations with Cosmos
Azure Cosmos: Backup Retention, Restores
IAM: Identity Access Management, Azure AD
Owner Role, Contributor & Reader Roles
Cosmos Backup Operator, Account Reader

Global Distribution Strategies, BCDR
Data Replication and High Availability
Multi Region Writes and Data Access
Azure Cosmos Database Cost Calculations
Availability Zones, Automated Failvoer
Azure Cosmos Database Management
Workloads and Multi Region Writes

Real-time Project @ Ecommerce Domain: Includes On-Premise Migrations with bac Files, Azure Storage Compoments, Azure Data Ingestions using Azure Data Factory; Big Data Storage with Azure Synapse and Azure Cosmos Database; Big Data Analytics using Azure Databricks and Azure Stream Analytics. This Real-time Project also includes End User Reporting with Power BI. Additionally includes Resume Support and DP 200, DP 201 Certification Guidance.

Power BI Training Content

Part 1: Power BI Report Design	Part 2: ETL, Data Modeling, DAX	Part 3: Power BI Cloud, Admin
Ch 1 : POWER BI BASICS Power BI Job Roles in Real-time Power BI Data Analyst Job Roles Business Analyst - Job Roles Power BI Developer - Job Roles Power BI for Data Scientists Comparing MSBI and Power BI Comparing Tableau and Power BI MCSA 70-778, MCSA 70-779 Exam Types of Reports in Real-World Interactive & Paginated Reports Analytical & Mobile Reports Data Sources Types in Power BI Power BI Licensing Plans - Types Power BI Training : Lab Plan Power BI Dev & Prod Environments	Ch 7 : POWER QUERY LEVEL 1 Power Query M Language Purpose Power Query Architecture and ETL Data Types, Literals and Values Power Query Transformation Types Table & Column Transformations Text & Number Transformations Date, Time and Structured Data List, Record and Table Structures let, source, in statements @ M Lang Power Query Functions, Parameters Invoke Functions, Execution Results Get Data, Table Creations and Edit Merge and Append Transformations Join Kinds, Advanced Editor, Apply ETL Operations with Power Query	Ch 13 : POWER BI CLOUD - 1 Power BI Service Architecture Power BI Cloud Components, Use App Workspaces, Report Publish Reports & Related Datasets Cloud Creating New Reports in Cloud Report Publish and Report Uploads Dashboards Creation and Usage Adding Tiles to Dashboards Pining Visuals and Report Pages Visual Pin Actions in Dashboards LIVE Page Interaction in Dashboard Adding Media: Images, Custom Links Adding Chs and Embed Links API Data Sources, Streaming Data Streaming Dataset Tiles (REST API)
Ch 2: BASIC REPORT DESIGN Power BI Desktop Installation Data Sources & Visual Types Canvas, Visualizations and Fields Get Data and Memory Tables In-Memory xvelocity Database Table and Tree Map Visuals Format Button and Data Labels Legend, Category and Grid PBIX and PBIT File Formats Visual Interaction, Data Points Disabling Visual Interactions Edit Interactions - Format Options SPOTLIGHT & FOCUSMODE CSV and PDF Exports. Tooltips Power BI EcoSystem, Architecture	Ch 8 : POWER QUERY LEVEL 2 Query Duplicate, Query Reference Group By and Advanced Options Aggregations with Power Query Transpose, Header Row Promotion Reverse Rows and Row Count Data Type Changes & Detection Replace Columns: Text, NonText Replace Nulls: Fill Up, Fill Down PIVOT, UNPIVOT Transformations Move Column and Split Column Extract, Format and Numbers Date & Time Transformations Deriving Year, Quarter, Month, Day Add Column : Query Expressions Query Step Inserts and Step Edits	Ch 14 : POWER BI CLOUD - 2 Dashboards Actions,Report Actions DataSet Actions: Create Report Share, Metrics and Exports Mobile View & Dashboard Themes Q & A [Cortana] and Pin Visuals Export, Subscribe, Subscribe Favorite, Insights, Embed Code Featured Dashboards and Refresh Gateways Configuration, PBI Service Gateway Types, Cloud Connections Gateway Clusters, Add Data Sources Data Refresh : Manual, Automatic PBIEngw Service, ODG Logs, Audits DataFlows, Power Query Expressions Adding Entities and JSON Files
Ch 3 : Visual Sync, Grouping Slicer Visual : Real-time Usage Orientation, Selection Properties Single & Multi Select, CTRL Options Slicer : Number, Text and Date Data Slicer List and Slicer Dropdowns Visual Sync Limitations with Slicer Disabling Slicers,Clear Selections Grouping : Real-time Use, Examples List Grouping and Binning Options Grouping Static / Fixed Data Values Grouping Dynamic / Changing Data Bin Size and Bin Limits (Max, Min) Bin Count and Grouping Options Grouping Binned Data, Classification	Ch 9 : POWER QUERY LEVEL 3 Creating Parameters in Power Query Parameter Data Types, Default Lists Static/Dynamic Lists For Parameters Removing Columns and Duplicates Convert Tables to List Queries Linking Parameters to Queries Testing Parameters and PBI Canvas Multi-Valued Parameter Lists Creating Lists in Power Query Converting Lists to Table Data Advanced Edits and Parameters Data Type Conversions, Expressions Columns From Examples, Indexes Conditional Columns, Expressions	Ch 15 : EXCEL & RLS Import and Upload Options in Excel Excel Workbooks and Dashboards Datasets in Excel and Dashboards Using Excel Analyzer in Power BI Using Excel Publisher in PBI Cloud Excel Workbooks, PINS in Power BI Excel ODC Connections, Power Pivot Row Level Security (RLS) with DAX Need for RLS in Power BI Cloud Data Modeling in Power BI Desktop DAX Roles Creation and Testing Adding Power BI Users to Roles Custom Visualizations in Cloud Histogram,Gantt Chart,Infographics
Ch 4 : Hierarchies, Filters Creating Hierarchies in Power BI Independent Drill-Down Options Dependant Drill-Down Options Conditional Drilldowns, Data Points Drill Up Buttons and Operations Expand & Show Next Level Options Dynamic Data Drills Limitations Show Data and See Records Filters : Types and Usage in Real-time Visual Filter, Page Filter, Report Filter Basic, Advanced and TOP N Filters Category and Summary Level Filters DrillThru Filters, Drill Thru Reports Keep All Filters" Options in DrillThru CrossReport Filters, Include, Exclude	Ch 10 : DAX Functions - Level 1 DAX : Importance in Real-time Real-world usage of Excel, DAX DAX Architecture, Entity Sets DAX Data Types, Syntax Rules DAX Measures and Calculations ROW Context and Filter Context DAX Operators, Special Characters DAX Functions, Types in Real-time Vertipaq Engine, DAX Cheat Sheet Creating, Using Measures with DAX Creating, Using Columns with DAX Quick Measures and Summaries Validation Errors, Runtime Errors SUM, AVERAGEX, KEEPFILTERS Dynamic Expressions, IF in DAX	Ch 16 : Report Server, RDL Need for Report Server in PROD Install, Configure Report Server Report Server DB, Temp Database Webservice URL, Webportal URL Creating Hybrid Cloud with Power BI Using Power BI DesktopRS Uploading Interactive Reports Report Builder For Report Server Report Builder For Power BI Cloud Designing Paginated Reports (RDL) Deploy to Power BI Report Server Data Source Connections, Report Power BI Report Server to Cloud Tenant IDs Generation and Use Mobile Report Publisher, Usage
Ch 5 : Bookmarks, Azure, Modeling Drill-thru Filters, Page Navigations Bookmarks : Real-time Usage Bookmarks for Visual Filters Bookmarks for Page Navigations Selection Pane with Bookmarks Buttons, Images with Actions Buttons, Actions and Text URLs Bookmarks View & Selection Pane OLTP Databases, Big Data Sources Azure Database Access, Reports Import & Direct Query with Power BI SQL Queries and Enter Data Data Modeling : Currency, Relations Summary, Format, Synonyms Web View & Mobile View in PBI	Ch 11 : DAX Functions - Level 2 Data Modeling Options in DAX Detecting Relations for DAX Using Calculated Columns in DAX Using Aggregated Measures in DAX Working with Facts & Measures Modeling : Missing Relations Modeling : Relation Management CALCULATE Function Conditions CALCULATE & ALL Member Scope RELATED & COUNTROWS in DAX Entity Sets and Slicing in DAX Dynamic Expressions, RETURN Date, Time and Text Functions Logical, Mathematical Functions Running Total & EARLIER Function	Ch 17: MSBI Integrations Power BI with SQL Server Source Power BI with SQL Data Warehouse Power BI with SSAS OLAP Server Power BI with Azure SQL DB Source Power BI with Azure SQL Warehouse Power BI with Azure Analysis Server Power BI with SSRS (RDL) Reports Power BI Report Builder Tool Installation & Configuration Paginated Reports Design, Use Data Sources, Datasets, RDL Report Publish (RDL) to Cloud Report Verifications, Data Sync Interactive Vs Paginated Reports Creating, Managing Alerts in Cloud
Ch 6 : Visualization Properties Stacked Charts and Clustered Charts Line Charts, Area Charts, Bar Charts 100% Stacked Bar & Column Charts Map Visuals: Tree, Filled, Bubble Cards, Funnel, Table, Matrix Scatter Chart : Play Axis, Labels Series Clusters & Selections Waterfall Chart and ArcGIS Maps Infographics, Icons and Labels Color Saturation, Sentiment Colors Column Series, Column Axis in Lines Join Types : Round, Bevel, Miter Shapes, Markers, Axis, Plot Area Display Units,Data Colors,Shapes Series, Custom Series and Legends	Ch 12 : DAX FUNCTIONS Level 3 1:1, 1:M and M:1 Relations Connection with CSV, MS Access AVERAGEX and AVERAGE in DAX KEEPFILTERS and CALCUALTE COUNTROWS, RELATED, DIVIDE PARALLELPERIOD, DATEDADD CALCULATE & PREVIOUSMONTH USERELATIONSHIP, DAX Variables TOTALYTD , TOTALQTD DIVIDE, CALCULATE, Conditions IF..ELSE..THEN Statement SELECTEDVALUE, FORMAT SUM, DATEDIFF Examples in DAX TODAY, DATE, DAY with DAX Time Intelligence Functions - DAX	Ch 18 : REAL-TIME PROJECT Project Requirement Analysis Implementing SDLC Phases Requirement Gathering, FSA Phase 1: PBIX Report Design Visualizations, Properties Analytics and Formating Phase 2: Data Modeling, Power Query Dynamic Connections, Azure DB Parameters and M Lang Scripts Phase 3: DAX Requriements, Analysis Cloud and Report Server Project FAQs and Solutions