Course Content

1.AZURE BASICS

• Azure Intro
• Tenant,Management Group,Subscription
•  Region, Avaiability zones, resource groups
•  UAT,SIT,Prod,Dev
• Azure cost center
• Azure Billing model
•  Types of services
  • Compute –VM,ADF,databricks
  • Storage – Storage accounts, DB, DWH,Datalakes,delta lake
  • Virtual networks –Virtual networks
  • ETL – adf
  • Security – IAM,AD
  • Datascience – Azure ML
  • Devops – Azure Devops integrated with GIT
  • Secrets – Key Vault

2. VIRTUAL NETWORK BASICS

• Azure virtual network introduction
•  How to create a VNET
• Subnets
• NSG & Firewalls (Intro)
• Private End points

3. SQL INTRO

• What is RDBMS
• What is SQL
• What is a database
• what is a schema
• What is Table
•  What are Datatype
• Types – DDL,DML,DCL-
• What are tables
• constraints on table : Primary Key, foreign key, unique key,not null
• Auto Increment
• What is a relation
• Sql Syntaxes : Select, insert, update and delete
• Data types and Type casting
• Sorting Data – Order by
• Filtering data -Where condition
• Distinct Data
•  Limiting Data
• Top n rows
•  Aliases (column and Table aliases)

4. SQL OPERATIONS

• Operators :
  • Comparison Operators
  • Logical Operators :
• Aliases
•  case statement : in select cluase and whereclause, using case statement to convert rows to columns
• datetime conversions
• string functions
• Aggregations :
•  Group by:
• Having
  • Where vs Having
•  subqueries
• corelated sub queries

5. ADVANCED SQL

• Operations between two tables :
  • Inner join, outer joins(left,right,cross)
  • union and unionall
  • EXISTS and NOT EXISTS
•  Window Functions
• Group by Vs Partition by
• CTE example
•  pivot and unpivot example
•  Merge
•  Temp Tables

6. AZURE COMPUTE

• Azure SQL and Virtual machines
•  DatafactoryVS Databricks (ETL Vs ELT)

7. AZURE KEY VAULT

• Key Vault Introduction
• Secrets
• Secrets Versioning
• Security/access control

8. AZURE FUNCTIONS & LOGIC APPS INTRO

• Azure Functions
•  Azure Logic Apps
•  What is Azure Container Services(ACI)
• What is Azure Kubernetis Services(AKS)

9. AZURE DATAFACTORY

• ETL Basics(Facts, DIM and SCD)
•  ADF intro
• Integration Services(Azure, Selfhosted and SSIS)
• Linked services(How to connect to various data sources)
•  Data sources
•  Private end points (intro)
•  Adf activities (Copy Data, Notebook, Variables, delete, execute pipeline, fail, getmetadata,
  lookup,script,storedprocedure, validation,web,wait, filter,foreach,if,switch etc.)
•  Integration with Databricks
•  Self hosted integration run time
• GIT integration

10.AZURE DATAFACTORY

• pipeline development
•  Expressions and parameters
•  Dynamic pipeline development using parameters
• Pipeline monitoring
• Data flow intro
• Dataflow activities(Source, Sink, New branch, Conditional Split, Exists, Union,Derived column, cast, filter, sort etc.)
• Triggers & Schedules
•  Debug mode
•  Trigger VS debug
•  Logging
•  Real time project

11. AZURE SYNAPSE

• Synapse intro
•  Synapse architecture
•  Sql pools
•  Built in vs dedicate pool
• Spark pools
• Pipelines
•  Monitoring
•  Security and admin activities
• Connection using jdbc
•  Distribtion
• Dedicated pool table types(round robin, replicated and hash distributions)
• External tables
• Querying external datasets
•  Integration with GIT

12. PYTHON

• Python Intro
•  Python Setup
• Pip
• Google Colab & Databricks Community Edition
• DataTypes and Variables
•  String Operations
• Loops and Conditional Statements
•  Collections
• Python Functions
• Anonymous Functions
•  Multi processings
•  flatmap
•  Oops with Python
• Magic Dunder Methods
•  Positional/inline parameters
•  Logging
• Multi Threads

13. SPARK

• Spark Introduction
•  Spark Core
•  Pyspark Architecture
•  Spark SQL
•  Different types of File Formats : Parquet, Avro, Json,CSV
•  Spark UI
•  DataframeAnd Dataset
•  Dataframe Operations
• Optimizations in Spark
•  Spark Structured Streaming

14. AZURE DATABRICKS

• Databricks intro
•  Databricks architecture
•  Delta lake intro
•  Merge operation
•  Insert, update and delete operations
•  Spark vs sql tables
• External and managed tables
• Mounting to azure storage
•  Accessing azure sql data
•  Integration with storage account
•  Secretes and scopes
•  Integration with key vault
•  Databricks Advanced Concepts(Delta Sharing, Genie, Unity Catalog, Governance, Delta Live Tables(SDP), Lakehouse Jobs, Lakebase)

15.AZURE DATABRICKS

• Widgets
• Calling notebooks inside notebooks
•  Passing parameters from ADF/synapse
•  Reading parameters from ADF/Synapse
• Scheduling
•  Integration with GIT

16. AI INTRO

• LLM Intro
• Tokens
•  Embeddings
• Different LLMs
• Inference using LLM
• How to use inference
•  Azure ML Intro
•  ChatGPT/Claude Agent
• Co-pilot introduction
• Langraph intro
• MCP Intro
• Your Coding partner