✅ Big Data
✅ Hadoop, Spark and Databricks
✅ Apache Spark Architecture
✅ Spark vs Databricks Comparison
✅ Comparing Apache Spark vs Databricks

✅ Azure Account Set Up
✅ Azure UI Overview
✅ Azure Resources
✅ Creating your Databricks Service
✅ Databricks UI Overview
✅ Clusters
✅ Pricing, Cluster Pools and Runtime Versions
✅ How to use Databricks Notebooks
✅ User Interface Changes
✅ Mix Languages and add Markdown text in your Notebook
✅ Databricks Utilities module and Filestore Utilities
✅ How to use Notebooks
✅ IMPORTANT – Download Course Resource Notebooks
✅ Cost Management and Cancelling your Subscription
✅ Cancelling your Azure Subscription

✅ Dataset Download
✅ Databricks FileStore (DBFS Browser)
✅ Resource: File Types
✅ Reading Data
✅ Writing Data
✅ Parquet Files
✅ Deleting Files and Folders

✅ Selecting and Renaming Columns
✅ Adding new column
✅ Changing Data Types
✅ Math Functions and Simple Arithmetic
✅ Sort Functions
✅ String Functions
✅ Datetime Functions
✅ Filtering DataFrames
✅ Conditional Statements
✅ Using SQL expression withexpr()
✅ Removing Columns
✅ Grouping your DataFrame
✅ Pivot your DataFrame
✅ Joining DataFrames
✅ Union
✅ Unpivot your DataFrame
✅ Pandas
✅ Medallion Architecture
✅ Visualizations and Dashboards
✅ Creating an ADLS Gen2 Account
✅ Storage Explorer
✅ Accessing via Access Keys
✅ Accessing via SAS Token
✅ Mounting ADLS to DBFS Overview
✅ Mounting ADLS to DBFS Demo
✅ Secret Scopes

✅ Running SQL on DataFrames
✅ Hive Metastore and Creating Databases
✅ Managed Tables
✅ Specifying a Location for your Underlying Managed Table Data
✅ Unmanaged (External) Tables
✅ Permanent Views

✅ Delta Lake Overview
✅ Delta Lake Data Files
✅ Deleting and Updating Records
✅ Merge Into
✅ Table Utility Commands

✅ Running a Notebook from another Notebook
✅ Text Widgets
✅ Defining Functions to Store Reusable Logic
✅ Registering Functions for SQL
✅ Python User Defined Functions (UDFs)
✅ Limitations of UDFs

✅ Spark Structured Streaming Overview
✅ ADLS Preparation for this Section
✅ Streaming Dataset “Simulator” Notebook
✅ Reading a Data Stream
✅ Reminder to Manually Cancel your Data Streams
✅ Writing to a Data Stream
✅ Additional Options
✅ Auto Loader

✅ Delta Live Overview
✅ Databricks Premium Resource Creation
✅ ADLS Preparation for this Section
✅ Demo 1: Live Tables
✅ Table Data and Pipeline Metadata
✅ Demo 2: Data Quality Checks
✅ Streaming Dataset “Simulator”
✅ Demo 3: Streaming Live Tables
✅ Demo 4: Additional Properties and Views

✅ Orchestrating Tasks with Databricks Jobs
✅ Task Failures
✅ Parameters and Task Values
✅ Job Scheduling with CRON Syntax

✅ Overview of ACLs
✅ Adding a New User to our Workspace
✅ Workspace Access Control
✅ Cluster Access Control
✅ Groups

✅ Databricks CLI Overview
✅ Command Line Basics (Navigating Directories)
✅ Installing, Setting Up and Authenticating the Databricks CLI
✅ Demo 1 (Cluster CLI Commands)
✅ Demo 2 (Workspace CLI Commands)
✅ Resource: CLI Commands

✅ Source Control on Databricks
✅ Azure DevOps Account Set Up
✅ Parallelism Request
✅ Connecting our Azure DevOps Repo to Databricks
✅ Databricks Repos Demo
✅ Running Jobs on Remote Git Notebooks
✅ Resources: Additional Information

✅ CI/CD and Solution Overview
✅ Reminder: Parallelism Request Form
✅ Build Pipeline (CI)
✅ Deploy to Test (CD)
✅ Deploy to Production (CD)