Master Delta Lake in Microsoft Fabric with Nick Lee. Learn to manage big data using Lake house architecture, create Delta tables, and use features like transaction logs, time travel, and schema evolution.
Embark on a journey to proficiently manage big data using Delta Lake within the Microsoft Fabric ecosystem. Guided by data engineer Nick Lee from Pragmatic Works, this course explores how Delta Lake integrates the flexibility of data lakes with the performance of data warehouses through the innovative lakehouse architecture. You'll learn to address big data challenges—volume, velocity, variety, and veracity—by leveraging Delta Lake's features like transaction logs, ACID compliance, and time travel for accessing historical data versions.
Through practical modules, discover multiple methods to create and integrate Delta tables, dynamically evolve schemas without rewriting entire tables, and optimize data management with partitioning, vacuuming, and performance tuning techniques. Understand the nuances between "overwrite" and "append" modes for data ingestion, and how to maintain data integrity and efficiency. By course end, you'll be equipped to leverage Delta Lake in Microsoft Fabric to build robust, scalable, and efficient data engineering solutions.
Course Outline ( Free Preview)
Module 01 - Introduction
Nick introduces Delta Lake and explains why it matters in Microsoft Fabric. You’ll get a roadmap of the concepts covered in the course, from table creation and transaction logs to maintenance and performance patterns. This module sets the foundation so you understand Delta Lake as more than just a file format, but as a key part of reliable lakehouse design.
Module 02 - Data Warehouse vs. Data Lake vs. Delta Lake
Learn the differences between a traditional data warehouse, a data lake, and Delta Lake. Nick explains where each approach fits, what problems they solve, and why Delta Lake helps bridge the gap between flexible storage and trustworthy analytics. You’ll leave with a clearer mental model for why Fabric lakehouses rely so heavily on Delta tables.
Module 03 - Creating Delta Tables23 min.
Start building by creating your first Delta tables in Fabric. Nick walks through what makes a Delta table different from ordinary files and how table creation supports structured querying, metadata, and reliable downstream reporting. This module gives you the hands-on foundation you’ll use throughout the rest of the course.
Module 04 - Shortcuts to Delta Tables18 min.
Explore how shortcuts help you work with Delta tables without duplicating data. Nick explains how shortcuts connect to existing data locations and why they are useful for simplifying access across lakehouses and workspaces. You’ll learn how shortcuts can improve organization while keeping data centralized and easier to manage.
Module 05 - Transaction Log25 min.
The transaction log is the engine that makes Delta Lake reliable. Nick breaks down what the log tracks, how it records changes, and why it enables features like ACID transactions, version history, and recovery. This module helps you understand what’s happening behind the scenes every time Delta data changes.
Module 06 - Time Travel13 min.
Learn how Delta Lake’s time travel feature lets you query earlier versions of a table. Nick explains practical use cases like auditing, debugging, and recovering from mistakes, then shows how versioned data supports safer experimentation and troubleshooting. You’ll see why time travel is one of Delta Lake’s most valuable reliability features.
Module 07 - Schema Evolution12 min.
Data structures change over time, and schema evolution helps you handle those changes without rebuilding everything from scratch. Nick explains how Delta Lake can adapt to new columns or updated structures, along with the risks of allowing too much flexibility. You’ll learn how to manage schema changes intentionally so your tables stay stable and understandable.
Module 08 - Overwrite vs. Append14 min.
Understand the difference between overwriting data and appending new records, and why that choice matters. Nick walks through common scenarios for each approach, such as full refreshes, incremental loads, and historical tracking. This module helps you choose the right write pattern so you don’t accidentally lose data or create duplicates.
Module 09 - Partitioning14 min.
Partitioning can improve performance and organization when used correctly. Nick explains how partitioning works in Delta Lake, when it helps, and when it can create unnecessary complexity. You’ll learn practical guidelines for choosing partition columns that support efficient querying without overengineering your table design.
Module 10 - Table Maintenance14 min.
Finish by learning how to keep Delta tables healthy over time. Nick covers maintenance concepts like file optimization, cleanup, and managing older versions so tables remain performant and storage stays under control. This module ties together the course by showing how long-term reliability depends on regular, thoughtful table management.
Nick has been a dedicated trainer and consultant since 2018, leveraging his extensive experience working with major companies, including Fortune 200 corporations, professional sports organizations, government entities, and leading firms in the finance and healthcare sectors. With a specialized focus on Power BI and data engineering, Nick has consistently demonstrated his ability to drive data-driven decision-making and optimize business processes. His commitment to excellence and his in-depth technical expertise have made him a trusted advisor and sought-after expert in the industry.
