Azure Data Factory Video Training

This impeccable Azure BI Training course is carefully designed for aspiring BI Developers, Consultants and Architects. This Azure BI Training includes basic to advanced Business Intelligence, Data Warehouse (DWH) and Data Analytics (OLAP) concepts on SQL Server Integration Services (SSIS), Analysis Services (SSAS) and Reporting Services (SSRS). This Azure BI Training course also includes Azure Data Factory (ADF), Azure DataWarehouse (ADW), Azure Analysis Services for Big Data Analytics and Forecasts. This Azure BI Training also includes Power Query, DAX and Data Mining Concepts with Real-time Project.

Complete practical and realtime Azure BI Training course with 24x7 LIVE server, Resume Guidance, ONE Real-time Project with Interview & Placement Assistance.

Azure Data Factory Training Plans

  PLAN A PLAN B PLAN C PLAN D
Description ADF SSIS, ADF SQL Basics,
SSIS, ADF
SQL Basics,
SSIS, ADF, Power BI
Total Duration 2.5 Weeks 5 Weeks 7.5 Weeks 11 Weeks
ADF : Architecture, Pipelines Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Copy Data Tool, Parameters Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Lookups, Incremental Loads Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Azure Data Flow, ETL Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Data Wrangling, Power Query Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Azure Dat Warehouse (Synapse) Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Massively Parallel Processing Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Self Hosted Integration Run Time Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : SSIS IR and SSIS DB Migrations Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : Architecture, ETL Packages Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : Control Flow, Data Flow Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : DWH & Dimension Loads Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : Fact Table Loads, SSISDB Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : Catalog DB, ETL Jobs Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SQL : Basic SQL, SQL Server Concepts Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL : Queries, Joins, Group By Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL : Queries, SProcs, Lock Hints Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL: Queries, Normal Forms, Excel Check-Symbol-for-Yes Check-Symbol-for-Yes
Power BI: Report Design, Visuals Check-Symbol-for-Yes
Power BI: Power Query & ETL Check-Symbol-for-Yes
Power BI: Data Modelling @ DAX Check-Symbol-for-Yes
Power BI: Cloud, Excel Analyzer Check-Symbol-for-Yes
Power BI: Mobile, R, REST API Check-Symbol-for-Yes
Power BI with Azure DWH (Synapse) Check-Symbol-for-Yes
Total Course Fee * INR 10,000
USD 136
INR 16,000
USD 217
INR 20,000
USD 271
INR 28,000
USD 379

*+ 18% GST applicable for INR Payments, 6% Paypal Charges for USD Payments

Trainer: Mr. Sai Phanindra T


ADF TRAINING HIGHLIGHTS :

✔ Basic to Adv. ETL ✔ Basic to Adv. DAX
✔ Data Modelling ✔ OLAP DB Design
✔ Power Query ✔ Basic to Adv. MDX
✔ Kimball BI Design ✔ Inmon BI Design
✔ Star, Snowflake ✔ Data Warehousing
✔ OLTP, File Data ✔ JSON, XML Data
✔ Resume Guidance ✔ MCSA MSBI Exam

All Session Are Completely Practical & Real Time

Azure Data Factory Training Course Contents:

Module I: Azure DATA Factory

Module II: AZURE DATA FACTORY

Module III: AZURE DATA FACTORY

Ch 1: AZURE BI INTRODUCTION

  • Introduction to Azure Cloud
  • Cloud Architecture and Components
  • IaaS: Infrastructure as a Service
  • PaaS: Platform as a Service
  • SaaS: Software as a Service
  • Azure Resources and ARM Concepts
  • Azure : Advantages and Pricing
  • Azure Data Factory Pricing Plans
  • BI : Business Intelligence Terms
  • Database Types: OLTP, OLAP, DWH
  • Need for MSBI and Azure BI
  • Azure BI Components: ADF,AAS,ADLS
  • Azure Data Factory Architecture
  • ADF : Data Processing, Movement
  • Data Mashup and ETL Components
  • Data Warehouse, Analysis Components
  • End to End Implementation Plan

Ch 5: Azure Database Migrations

  • Database and Data Migration Options
  • Azure Data Migrations with DMA Tool
  • On-Premise Database Assessments
  • Migration Scope, Object Scripting
  • Schema Migration and Data Migrations
  • Database Exports into BACPAC Files
  • Azure Storage Container For Imports
  • Database Imports using Azure Portal
  • Database Imports using SSMS Tool
  • On-Premise Versus Azure Architecture
  • Server Architecture Differences
  • Database Architecture Differences
  • Table Architecture Differences
  • Query Processing Differences
  • T-SQL Query Keyword Differences
  • Memory Resources, Buffer Manager
  • DB File Structures and Protocols
  • SQL Server Logical Server in Azure

Ch 9 : INCREMENTAL DATA LOADS 1

  • Incremental Data Loads with ETL
  • Incremental Loads in ADF Portal
  • Source Data & Watermark Column
  • Watermark Tables : Creation, Use
  • TimeStamp For Incremental Loads
  • Configuration Procedures for ETL
  • Using Lookup Activities in ADF
  • Lookup Transformation with ADF
  • Watermark Column Extraction
  • Activity Connections in ADF Portal
  • Expressions and Usage in ADF
  • Generating New Watermark Columns
  • Lookup Output Row Level Audits
  • Stored Procedures and Dynamic Values
  • Parameterized Values for Data Extraction
  • Using ADF Run IDs for Connections
  • Parameter Imports and Staging Options
  • Working with Lookup Connections in ADF
  • Output() Functions & Item() Functions

Ch 2: SSIS BASICS, INSTALLATIONS

  • Database Types: OLTP, DWH, OLAP
  • SQL Server, Tools Installations
  • Database Engine & SSIS Components
  • Need for ETL Components, Tools
  • SSIS Basics and Package Environment
  • Azure Data Factory (ADF) Pipelines
  • SSIS versus ADF : Basic Differences
  • ADF : Workflow & Data Source Types
  • Versions and Editions of SQL Server
  • SSMS Tool Installation, Connections
  • SSIS DB Creation and Connection
  • SSIS Catalog and Real-time Use
  • SSDT (Visual Studio) Installation
  • Azure Data Studio Tool Installation
  • SQL Server Connection @ SSDT
  • SQL Server Connection @ ADS

Ch 6: AZURE DATA WAREHOUSE

  • Azure Data Warehouse (ADW)
  • Key Benefits of Azure Synapse
  • ADWH Resource Creation in SQL Server
  • Scaling Options, Compute Engine
  • ADW Connection from SSMS Tool
  • Data Warehouse Details: Name, Server
  • cDWU & DWU : Real-time Usage, Pricing
  • DWs and Scaling Options: DW Series
  • Massively Parallel Processing (MPP)
  • Sharding Benefits with MPP in DWH
  • Control Node and Compute Node
  • Data Distribution Components in ADW
  • DMS : Data Movement Service
  • Hash Functions, Distributed Tables
  • Round-robin Distributed Tables
  • Replicated Tables in Azure DWH
  • Queries Distribution, Nodes in ADW
  • Dynamic Management Views (DMV)

Ch 10 : INCREMENTAL DATA LOADS 2

  • Incremental Loads - Multiple Tables
  • Data Prep for Watermark Store
  • ForEach Activity and Real-time use
  • Lookup Activities Use in ADF
  • Linked Service Parameters, Use
  • Copy Data Activity for ETL in ADF
  • Stored Procedure Activity for ETL
  • Data Pipelines Parameters in ADF
  • Object Name Parameters, Iterations
  • Using Self Hosted IR Engine in ADF
  • Incremental Loads with Azure Storage
  • Dynamic Sources and Destinations
  • Data Preview & Dynamic Content
  • Linked Services & Datasets Creations
  • ADF Pipeline Executions, Run IDs
  • Dynamic File Formats and Connections
  • ADF Pipeline, Trigger Execution Runs

Ch 3: SSIS & ETL Basics

  • Basic Vocabulary: ETL, DWH, Data Flow
  • SSIS Package Environment and Projects
  • SSIS Solutions and Project Templates
  • Control Flow Tasks: Architecture, Purpose
  • Data Flow Tasks - Architecture and Usage
  • SSIS Packages: Data Flow Operations
  • Pipelines & Connections in Data Flow
  • SSIS Package Design and Execution
  • Basic SSIS Package Creation for ETL
  • Using Transformations in SSIS
  • DTSX Files for SSIS Package Executions
  • Data Flow Transformations, Data Splits
  • Basic Transformations: Conditional Split
  • Data Conversion Transformation, ETL
  • Source Assistants & Destination Assistants
  • SSIS Project Builds and ISPAC Files
  • SSIS Package Deployment, Verification
  • SSIS Package Executions, Schedules
  • Limitations of SSIS for ETL & DWH

Ch 7: ADF BASICS, COPY DATA TOOL

  • Azure Data Factory Architecture
  • ADF : Data Processing Components
  • ADF : Data Movement Components
  • Data Pipelines and ADF Activities
  • Data Orchestration and Datasets
  • ADF Resource Creation in Azure
  • Pipeline Concept, Linked Services
  • SSIS Lift and Shift with ADF
  • Azure Data Factory (ADF) : Purpose
  • Creating ADF Resource in Azure, Use
  • Pipeline Creation and Usage Options
  • Copy Data Tool in ADF Portal, Use
  • Linked Service Creation in ADF
  • Dataset Creation, Connection Reuse
  • Staging Dataset with Azure Storage
  • ADF Pipeline Deployments, Triggers
  • Polybase Benefits for Data Staging

Ch 11: AZURE DATA LAKE, ADF

  • Azure Data Lake Storage Environment
  • Azure Data Lake Gen 1 and Gen 2
  • Using ADF to get data from Data lake
  • ADF Integration with Azure Data Store
  • Scale-Out and Managed Data Transfer
  • Copy Data Performance Monitoring
  • Monitor, Activity Runs and Options
  • Data Partition Recommendations in ADL
  • Size Limitations and ADF Activities
  • Azure Data Warehouse Management
  • Threat Detection, Threat Protection
  • Dynamic resource classes, ADW Queries
  • Resource Class Operations & Precedence
  • Backups and Restores with ADWH
  • Export and Import Options with ADWH
  • TDE Option and Maintenance Schedules
  • Security Management, Role Based Access
  • Azure DWH Alerts and Rule Creations

Ch 4: Azure SQL Server, Database

  • Azure SQL Server Deployments
  • Azure Logical Servers, Usage
  • DataCenter Locations, Collation
  • Azure Resource Groups and Usage
  • Azure SQL Database Deployment
  • Azure Pricing Tiers: Basic Plan
  • Standard and Premium Plans
  • Azure SQL DB Connections @ SSMS
  • Azure SQL DB Connections @ ADS
  • Azure Storage : Purpose, Tools
  • Azure Storage Explorer Tool
  • Azure Storage Container, Use
  • Azure Blob Storage and Types
  • LRS, GRS and RA - GRS Storage
  • Hot Access, Replication Options
  • File Storage (Uploads) to Azure
  • Azure Storage Security Options

Ch 8: ETL WITH AZURE SQL DB

  • Copy Data From Azure SQL Database
  • Azure SQL Data Warehouse Sinks
  • Data Sets Creation, ADF Data Pipelines
  • Activities : Move & Transform for ETL
  • Actions and View Activity Runs
  • ADF Pipeline Monitoring and Refresh
  • ADF Triggers - Manual, Automatic
  • Azure Database to Azure Data Warehouse
  • Data Integration Units [DIU] Usage
  • Azure Data Factory Runtime Engine
  • On-Premise Data Extraction and Loads
  • Self Hosted IR in Copy Data Tool
  • IR Engine Installation, Key Concepts
  • IR Connections & Authentication Methods
  • IR Tool Configuration and Monitoring
  • Azure Storage Linked Service, Reuse

Ch 12: ADF MIGRATIONS FROM SSIS

  • Execute SSIS Packages in Azure
  • Azure-SSIS Integration Runtime, SSDT
  • Azure-SSIS IR Creation and Use
  • IR Setup and Cluster Size, Nodes
  • License Options, Location, Cores
  • Node Numbers & Parallel Executions
  • SSISDB Project Deployment Model
  • Execute SSIS Package Activity
  • Executing SSIS Packages in ADF
  • SSIS Project Connections to ADF
  • Azure Storage for SSIS Packages
  • Execute SSIS packages in Azure
  • SSIS Package Migrations to ADF
  • SSIS Catalog DB with ADF
  • On-Premise SSIS Versus Azure
  • SSIS Lift and Shift with ADF
  • Branching and Chaining in ADF
  • Data Lineage and Tagging in ADF

Module I: Basic SSIS Development & ETL - DWH

Module II: Advanced SSIS Development & Deployments

Ch 1: SSIS INTRODUCTION & INSTALLATION

  • Need for SQL Server Integration Services (SSIS) & ETL / DWH
  • Advantages of SSIS for Data Loads, Operations, ETL, Warehouse
  • SSIS Tools : SSDT (SQL Server Data Tools), ETL Wizards
  • SSIS Design / Development and LIVE (Deployment) Environment
  • Understanding Data Warehouse (DWH) Design and ETL Process
  • DWH and ETL Structures, Implementations with MSBI SSIS
  • SSIS ETL Operations for Data Reads, Data Cleansing, DWH
  • Data Warehouse (DWH) Design Principles and Design Plan
  • SSIS 2019 and SSIS 2017 : SSIS Database Installations
  • SSIS Database & Catalog Folders - Purpose, Usage, Passwords
  • SSIS Catalog Database (SSIS DB) : Creation, Verification
  • SSDT Tool: SQL Server Data Tools - SSDT / Visual Studio Shell
  • SSDT Installation and Verification of SSIS Templates
  • Basic Vocabulary - SSIS, ETL, DWH, Data Flow, Data Buffer
  • SSIS Package Environment and SSDT Project Creation
  • SSIS Solutions and Project Templates - Verifications
  • Version Control Options and SSIS Design Plan - Tools Usage
  • SSIS & ETL Training - Lab Plan, Resources & Work Flow

Ch 7: CHECKSUM TRANSFORMATION, DWH DESIGN

  • Configuring Checksum Transformation : 2019, 2017 Versions
  • Checksum Transformation Logic and Parity Checks (CRC) Codes
  • Working with CHECKSUM Transformation & Parity Bit Columns
  • Generating Checksum Values For Type I, Type II ETL Changes
  • DWH Dimension Tables With Checksum Transformation
  • Working with Parity Bits, Conditional Lookup Transformation
  • Row Redirection Options & Lookup Match, NonMatch Output
  • OLE DB Command: SQL Statements and Input Parameters
  • Parameter Mapping Options and Dynamic SQL for Row Updates
  • Cache Transformation with Memory Loads, CAW Files (VM)
  • Memory Connections and Reuse. Lookup with Cache Options
  • Tuning Lookup Transformation: Caching Options, Index Options
  • FULL CACHE & PARTIAL CACHE. Cache Connection Manager
  • Pre-ETL Data Load Operations with Memory Connections
  • Lookup with NOCACHE Options. Dependent Data Flow Tasks
  • Post ETL, Derived Column and Fuzzy Transformations
  • SSIS Package Internal Parameters and Query Updates
  • OLEDB Command with Conditional Splits, Multi Row Updates

Ch 2: SSIS ETL PACKAGES: EXTRACT,TRANSFORM,LOAD

  • Control Flow Tasks - Architecture, Purpose and Usage
  • Data Flow Tasks - Architecture, Purpose and Usage
  • Creating SSIS Packages For Basic Data Flow Operations
  • SSIS Solutions, Projects and Package Creation. Tasks
  • Need For Data Pipelines & Connections in Data Flow Tasks
  • Understanding SSIS Package (Program) Execution Process
  • Working with Data Flow Objects and Tasks in SSIS
  • Using OLE DB and SQL Server Connections - Usage
  • SSIS Package Creation Process - Using Control Flow Items
  • Using DTSX Files for SSIS Package Execution. Audits
  • SSIS Execution Context, SSIS Package Errors and Logs
  • Data Flow Transformation: Conditional Split, Expressions
  • Excel Connections, Sheets, & Memory References - Usage
  • Using Source Assistants, Destination Assistants @ SSIS
  • DAT File Imports, Data Flow Options, Adding Annotations
  • SSIS Project Configuration Options - Debugging, Bit Config
  • SSIS 64 Bit and 32 Bit Configuration Settings and Options

Ch 8: CHANGE DATA CAPTURE: DWH DIMENSIONS

  • Understanding CDC Tables with SQL Server Connections
  • DML Audits: Inserts, Deletes, Values before/after Updates
  • CDC Source Connections - Usage, ADO.NET Integration
  • CDC Control Flow Tasks and CDC State Tasks. Values
  • INITIAL LOAD START / END. PRCESSING RANGE
  • Using State Variables and Controls. Storing States
  • SSIS CDC Source Connections with Net Support Changes
  • SSIS CDC Control Tasks and Caching, State Variables
  • Understanding State Variables and SSIS Logging Tables
  • Initial and Incremental Dimension Loads with CDC
  • Dynamic CDC Connections, Parameter Mapping
  • Integrating Control Flow and Data Flow for CDC @ ETL
  • CDC Splitter Transformation - Row Inserts and Updates
  • CDC Splitter Precautions, Input Types and Output Range
  • Master Packages and Child Packages, Derived Columns
  • Defining Local and Global Variables/Parameters
  • Parameter Bindings with Parent - Child Packages

Ch 3: MERGE, FUZZY LOOKUP, DATA CONVERSION

  • MERGE Transformation and UNION ALL Transformation
  • SORT Transformation, NOSORT Options, Advanced Sort
  • Synchronous & Asynchronous Transformations, Data Loads
  • Row and Partial Blocking Transformations. Buffer Reuse
  • Fully Blocking Transformations - Buffer Reuse Restrictions
  • Examples to Avoid Fully Blocking Transformation in SSIS
  • Bulk Load Operations and Data Import Options in SSIS
  • IsSorted and SortKey Positions with Advanced Options
  • Measuring SSIS Package Performance & Resource Usage
  • Data Conversion Transformation and SSIS Expressions
  • Fuzzy Lookup Transformation, Reference Table Connections
  • Exact, Fuzzy & Nomatch Data Cleansing with Conditional Split
  • Index Creation, Maintenance for Faster Lookup Transformation
  • Data Conversion Transformation - Usage. Derived Columns
  • Data Conversion Transformation: NVARCHAR, VARCHAR Data
  • Threshold Values Selection, Search Delimiters and Options
  • Data Pipeline with _Similarity, _Confidence Columns. Usage
  • Explicit Data Type Conversions and Usage. Error Redirections

Ch 9: FACT TABLE DESIGN, FACT LOADS (DWH)

  • Fact Table - Design and Implementation Rules, ER Model
  • Fact Table Design with STAR and SNOWFLAKE Schemas
  • Time Dimensions - Purpose, Usage and ETL Date / Time
  • Generating Time Dimensions for ETL, Load Identification
  • Parent-Child Packages for Dimensional Loads, Control Flow
  • Parent-Child Packages for Dimensions & Fact Table Loads
  • Master Package Design: Dimension, Fact Load Integration
  • Inferred Members and Status for NULLs in Dimensions
  • Parameter Mapping @ ETL Updates, Component Properties
  • ETL Load Date IDs & Expressions for Dimension Keys
  • Error Handling & Event Handling with Master Packages
  • Text Qualifiers and Parameters in Master-Child Packages
  • Key Based Dimension LOOKUPs and Indexes. Fast Loads
  • SCD Implementations with Legacy Data. ETL Load Types
  • Fact Load Design for Initial Loads, Incremental Updates
  • End-to-End Data Warehouse Design: Implementation
  • Direct Data Loads and Data Stage Operations for DWH DBs
  • STAR & SNOWFLAKE Schemas for DWH - Data Modelling

Ch 4: PACKAGE PROPERTIES, CHECKPOINT, PIVOT

  • Execute SQL Task and OLE DB Queries - Connection Options
  • Transaction Options For SSIS Executables - Package Level
  • Precedence Constraints - Success / Failure / Completion
  • SSIS Package Level Rollbacks and Restart Execution Options
  • SSIS Checkpoints - Purpose and Usage with Data Flow Tasks
  • Checkpoint Files and SSIS Logging Options - Package, Tasks
  • Transactions with Checkpoint File Usage in SSIS Packages
  • Checkpoint Options - Advantages, Usage and Limitations
  • FailPackageOnFailure Options and Checkpoint Property Usage
  • Transaction Property : REQUIRED / SUPPORT, NOTSUPPORTED
  • Transaction Property Versus CHECKPOINT Files, Usage
  • Importing Legacy Data, Need for Data Cleansing, Formatting
  • Understanding Denormalization and Keys. Need for OLTP
  • PIVOT Transformation, Data Reads, Connection Assistant
  • Pivot Usage Values - Purpose and Implementation. Key Values
  • Lineage ID in SSIS - Purpose, Usage Options. Data Mappings
  • Lineage IDs for Column Mapping and Pivot Keys
  • SSIS Input Columns, Mappings and Source Column Values
  • Using Data Viewer (Debugging) for Data Transfer Verifications
  • Explicit Data Type Conversions, Usage. Error Redirections

Ch 10: DWH MIGRATIONS with SSIS, SCRIPT Task

  • DataWarehouse Migrations with SSIS Control Flow
  • Using SSIS Containers and Db Integrity Task
  • Using Pre-Database Migration Tasks, Precautions
  • Transfer Database Task and DB File Options
  • Online and Offline DB Transfer Options, Usage
  • Copy / Move Options with DWH Migrations
  • SMTP : Simple Mail Transfer Protocol For Emails
  • Using SQL Server Agent Operators, Package Events
  • Precedence Constraint with Containers, SSIS Tasks
  • Using Data Profiling Task with ADO.NET Connectors
  • XML Files Generation, Using SSIS Data Profiler Tool
  • Script Task - Purpose and Working in SSIS Control Flow
  • Script Task - Usage with VB.NET Programs. Compilations
  • Variables and Parameters with SSIS Script Task. Usage
  • Read Only and Read Write Variables. Expressions, Mapping
  • Data Flow Limitations : Solutions with .NET Scripting
  • SSIS Expressions and Package Debugging, Break Points
  • SSIS Variables and Parameters - Mapping Expressions
  • Using Control Flow File System Tasks and Limitations
  • SQLDataAdapters & System.Data.SQLClient Connections

Ch 5: EVENTS, LOOPS, EXPRESSIONS

  • SSIS Package Events : Validation Events, Execution Events
  • PreExecution, Progress and Cleanup Events in SSIS
  • Auditing SSIS Events, Errors / Warnings / Information
  • Configuring and Using sysssislog System Tables
  • Package Debugging : Data Viewers and Breakpoints
  • ForEach Loop Container Usage. File Connections, Variables
  • Defining Variables for Connections. DFT, Control Flow Links
  • Dynamic Connections with Variables. Connection Strings
  • Connection Iterations, Connection Fetch, Index Mapping
  • SSIS Expressions and Usage for ETL and DWH
  • FOR LOOP Expressions in SSIS, Examples for ETL
  • InitExpression, EvalExpression, AssignExpression
  • SSIS Expression Builder, Functions, Evaluated Values
  • Data Insertions and Data Serializations with SSIS
  • Counter Values, Variables and Parameter Mapping
  • Using SSIS for OS Level Drive Operations, Loops
  • Using Execute SQL Task : Variables, Return Values

Ch 11: SSIS PROJECT DEPLOYMENT, UPGRADES

  • SSISDB Catalog Deployments - Process & ISPAC Files
  • SSIS Package Builds, Verification Techniques, Scripts
  • SSIS Project Deployment Wizard : Targets and Logging
  • SSIS DB Catalog Folders - Creation, Usage. Properties
  • SSIS DB Catalog Projects - Creation, Usage. Properties
  • SSIS Package Executions - Scripts, Reports, Messages
  • Package Validations - Scripts, Reports, 32/64 bit Options
  • Package Configurations - Parameter Management, Scripts
  • SSIS Package Jobs @ SQL Server Agent. SSIS Job Steps
  • SSIS Job Schedules and Notifications: Windows Event Logs
  • Package Security Management - SSISDB Logins and Users
  • Folder Level and Project Level Security Implementation
  • Project Migration Utilities and Package Upgrades
  • SSIS Package Imports and Exports with ISPAC Files
  • Command-Line Deployments For SSIS, Execution Utilities
  • SSIS Package Execution Reports; Validation Reports
  • SSIS Package Versions and Restores, SSIS Rollbacks

Ch 6: DATAWAREHOUSE (DWH) DESIGN WITH SSIS

  • Introduction to Datawarehouse (DWH) - Purpose, Usage, Access
  • Technical Terms: Dimensions, Attributes, Members and Types
  • Dimension Tables, Fact Tables and Relations, Inferred Members
  • TYPE1 and TYPE2 Changes. ETL Implementation Techniques
  • Implementing Type I Changes (SCD) for DWH : Sales Scenario
  • Dimensional Table Design for DWH using SCD - Type 1, Type 2
  • Initial Data Loads with Legacy Files (DAT, TXT, CSV), Data Marts
  • Working with Business Keys, non Identity Key Based Columns
  • Surrogate Keys and Alternate Business Keys - Purpose, Usage
  • Identity Columns, Key Values in DWH. Business Key Limitations
  • Cascading Source OLTP / Stage Changes to DWH Inactive Rows
  • Changes to Fixed Attributes, Changing Attributes. Observations
  • Changes to Historical Attributes. Inferred Member Updated
  • ETL Date Fields, Row Status Values and Transformations
  • Designing Dimensions for DW - Incremental, Historical Loads
  • Historical Attributes, Data Delta Operations, Identification
  • SSIS SCD Transformation Limitations and Real-time Issues

Ch 12: SSIS PROJECT [ECommerce Domain]

  • SSIS ETL & DWH with STAR Schema
  • SSIS ETL & DWH with SNOWFLAKE Schema
  • Dimension Table Design & Business Keys
  • Fact Table Design & Data Integrity
  • Incremental Data Loads with Containers
  • Key Lookup and Business Key Identification
  • Staging Tables, Master - Child Packages
  • SSIS Package Deployment [Catalog Deployments]
  • SSIS Training : Project Specifications
  • Project Explanation and Solution
  • Project FAQs and Resume Support
  • Chapter Wise FAQs and Answers
  • Concept Wise Tasks and Solutions
  • SSIS DWH Databases with Reports
  • Technical Resume Points in SSIS
  • SSIS Limitations and Need for ADF
  • End to End Implementation [MSBI]

Ch 1: SQL SERVER INTRODUCTION

  • Data, Databases and RDBMS Software
  • Database Types : OLTP, DWH, OLAP
  • Microsoft SQL Server Advantages, Use
  • Versions and Editions of SQL Server
  • SQL : Purpose, Real-time Usage Options
  • SQL Versus Microsoft T-SQL [MSSQL]
  • Microsoft SQL Server - Career Options
  • SQL Server Components and Usage
  • Database Engine Component and OLTP
  • BI Components, Data Science Components
  • ETL, MSBI and Power BI Components
  • Course Plan, Concepts, Resume, Project
  • 24 x 7 Online Lab for Remote DB Access
  • Software Installation Pre-Requisites

Ch 5: SQL Basics - 3, T-SQL INTRO

  • Database Objects : Tables and Schemas
  • Schemas : Group Tables in Database
  • Schemas : Security Management Object
  • Creating Schemas & Batch Concept
  • Using Schemas for Table Creation
  • Data Storage in Tables with Schemas
  • Data Retreival and Usage with Schemas
  • Table Migrations across Schemas
  • Import and Export Wizard in SSMS
  • Data Imports with Excel File Data
  • Performing Bulk Operations in SSMS
  • Temporary Tables : Real-time Use
  • Local and Global Temporary Tables
  • # and ## Prefix, Scope of Usage

Ch 9: JOINS, T-SQL QUERIES Level 3

  • GetDate, Year, Month, Day Functions
  • Date & Time Styles, Data Formatting
  • DateAdd and DateDiff Functions
  • Cast and, Convert Functions in Queries
  • String Functions: SubString, Relicate
  • Len, Upper, Lower, Left and Right
  • LTrim, RTrim, CharIndex Functions
  • MERGE Statement - Comparing Tables
  • WHEN MATCHED and NOT MATCHED
  • Incremental Load with MERGE Statement
  • IIF() Function for Value Compares
  • CASE Statement : WHEN, ELSE, END
  • ROW_NUMBER() and RANK() Queries
  • Dense Rank and Partition By Queries

Ch 2: SQL SERVER INSTALLATIONS

  • System Configuration Checker Tool
  • Versions and Editions of SQL Server
  • SQL Server and SSMS Installation Plan
  • SQL Server Pre-requisites : S/W, H/W
  • SQL Server 2016 / 2017 Installation
  • SQL Server 2019 Installation
  • Instance Name and Server Features
  • Instances : Types and Properties
  • Default Instance, Named Instances
  • Port Numbers, Instance Differences
  • Service and Service Account Use
  • Authentication Modes and Logins
  • Windows Logins and SQL Logins
  • FileStream and Collation Properties

Ch 6 : CONSTRAINTS,INDEXES Basics

  • Constraints and Keys - Data Integrity
  • NULL, NOT NULL Property on Tables
  • UNIQUE KEY Constraints: Importance
  • PRIMARY KEY Constraint: Importance
  • FOREIGN KEY Constraint: Importance
  • REFERENCES, CHECK and DEFAULT
  • Candidate Keys and Identity Property
  • Database Diagrams and ER Models
  • Relationships Verification and Links
  • Indexes : Basic Types and Creation
  • Index Sorting and Search Advantages
  • Clustered and NonClustered Indexes
  • Primary Key and Unique Key Indexes
  • Need for Indexes - working with Keys

Ch 10: VIEW, SPs, Function Basics

  • Views : Types, Usage in Real-time
  • System Predefined Views and Audits
  • Listing Databases, Tables, Schemas
  • Functions : Types, Usage in Real-time
  • Scalar, Inline and Multi-Line Functions
  • System Predefined Functions, Audits
  • DBId, DBName, ObjectID, ObjectName
  • Variables & Parameters in SQL Server
  • Procedures : Types, Usage in Real-time
  • User & System Predefined Procedures
  • Parameters and Dynamic SQL Queries
  • Sp_help, Sp_helpdb and sp_helptext
  • sp_pkeys, sp_rename and sp_help
  • Important System Objects and Metadata

Ch 3: SSMS Tool, SQL BASICS - 1

  • SQL Server Management Studio
  • Local and Remote Connections
  • System Databases: Master and Model
  • MSDB, TempDB, Resource Databases
  • Creating Databases : Files [MDF, LDF]
  • Creating Tables in User Interface
  • Data Insertion & Storage. Limitations
  • SQL : Purpose and Real-time Usage
  • SQL Versus T-SQL : Basic Differences
  • DDL, DML, SELECT, DCL and TCL
  • Creating Tables using SQL Scripts
  • Data Storage, Inserts - Basic Level
  • Table Data Verifications with Select
  • SELECT Statement for Table Retrieval

Ch 7: JOINS, T-SQL Queries : Level 1

  • JOINS - Table Comparisons Queries
  • INNER JOINS For Matching Data
  • OUTER JOINS For (non) Match Data
  • Left Outer Joins with Example Queries
  • Right Outer Joins with Example Queries
  • FULL Outer Joins - Realtime Scenarios
  • Join Queries with "ON" Conditions
  • Join Unrelated Tables in SQL Server
  • NULL, IS NULL Operators in Joins
  • CROSS JOIN and CROSS APPLY
  • CROSS JOIN Versus CROSS APPLY
  • One-way & Two Way Data Comparisons
  • Important Join Queries in T-SQL
  • Join Options: Merge, Loop, Hash

Ch 11: Triggers & Transactions

  • Triggers - Purpose, Real-world Usage
  • FOR/AFTER Triggers - Real time Use
  • INSTEAD OF Triggers - Real time Use
  • INSERTED, DELETED Memory Tables
  • Using Triggers for Data Replication
  • Enable Triggers and Disable Triggers
  • Database Level, Server Level Triggers
  • Transactions : Types, ACID Properties
  • Transaction Types and AutoCommit
  • EXPLICIT & IMPLICIT Transactions
  • COMMIT and ROLLBACK Statements
  • Open Transaction Scenarios & Cause
  • Query Blocking Scenarios @ Real-time
  • NOLOCK and READPAST Lock Hints

Ch 4: SQL BASICS - 2

  • Creating Databases & Tables in SSMS
  • Single Row Inserts, Multi Row Inserts
  • Rules for Data Insertion Statements
  • SELECT Statement @ Data Retrieval
  • SELECT with WHERE Conditions
  • Batch Concept and Go Statement
  • AND and OR Operators Usage
  • IN Operator and NOT IN Operator
  • Between, Not Between Operators
  • LIKE and NOT LIKE Operators
  • UPDATE Statement & Conditions
  • DELETE & TRUNCATE Statements
  • Logged and Non-Logged Operations
  • ADD, ALTER and DROP Columns
  • ALTER & DROP Table Statements

Ch 8: Group By, T-SQL Queries Level 2

  • GROUP BY Queries and Aggregations
  • Group By Queries with Having Clause
  • Group By Queries with Where Clause
  • Using WHERE and HAVING in T-SQL
  • Rollup : Usage and T-SQL Queries
  • Cube : Usage and T-SQL Queries
  • UNION and UNION ALL Operator
  • EXISTS Operator, Query Conditions
  • Sub Queries and Alternatives to Joins
  • Using Joins with Group By Queries
  • Using Joins with Nested Sub Queries
  • Sub Queries with Joins and Group By
  • Using UNION and UNION ALL in Queries
  • Nested Sub Queries with Group By, Joins
  • Comparing WHERE, HAVING Conditions

Ch 12 : ER MODELS, NORMAL FORMS

  • Normal Forms for Entity Relationships
  • First Normal Form and Atomocity
  • Second Normal Form, Candidate Keys
  • 3rd Normal Form Multi Value Dependancy
  • Boycee-Codd Normal Form : BNCF
  • Fourth Normal Form Realtime Advantages
  • Self Joins & Self Reference Keys
  • 1:1, 1:M, M:1, M:M Relationship Types
  • Joins with Group By Queries
  • Joins with Sub Queries, Formating
  • Office Data Connections, Excel Reports
  • Excel Pivot Reports and Reports
  • SQL Queries (Auto Generated) in BI Tools
  • FETCH OFFSET, NEXT ROWS, Order By
  • Data Refresh (Manual and Automated)
Real-time Case Study - 1 (Sales & Retail)
Objective : Database Design, Table Design and Relations.
Involves Purchases, Products, Customers and Time Data with Various Data Types.
Real-time Case Study - 2 (Sales & Retail)
Objective : Queries, Excel Integration
Pivot Tables, Pivot Charts, ODC Connections
LIVE ADF Online Training Course Curriculum : Brochure
 

Job-Oriented Real-time Training @ SQL School Training Institute

SQL Server, SQL DBA, MSBI, Azure SQL Dev, Azure SQL DBA, Power BI Training