Course Description
Embark on a journey to proficiently manage big data using Delta Lake within the Microsoft Fabric ecosystem. Guided by data engineer Austin Libal from Pragmatic Works, this course explores how Delta Lake integrates the flexibility of data lakes with the performance of data warehouses through the innovative lakehouse architecture. You'll learn to address big data challenges—volume, velocity, variety, and veracity—by leveraging Delta Lake's features like transaction logs, ACID compliance, and time travel for accessing historical data versions.
Through practical modules, discover multiple methods to create and integrate Delta tables, dynamically evolve schemas without rewriting entire tables, and optimize data management with partitioning, vacuuming, and performance tuning techniques. Understand the nuances between "overwrite" and "append" modes for data ingestion, and how to maintain data integrity and efficiency. By course end, you'll be equipped to leverage Delta Lake in Microsoft Fabric to build robust, scalable, and efficient data engineering solutions.