Get started with Microsoft Fabric Pipelines in this beginner-friendly course by Nick Lee. Learn what pipelines are, how to build and run them, and how to monitor activity so your data workflows stay reliable and repeatable.
In Introduction to Fabric Pipelines, Nick Lee walks you through how data pipelines work in Microsoft Fabric and why they’re a core building block for reliable analytics. You’ll learn what pipelines are designed to do, how they compare to other Fabric experiences, and where they fit in an end-to-end workflow, moving data from source to destination, preparing it for modeling, and keeping everything refreshable and repeatable. This course focuses on the practical foundation, understanding what pipelines are, what they’re good at, and how to approach them with confidence.
You’ll also learn how to build and run a basic pipeline, step by step. Nick covers core concepts like activities, sequencing, connections, and monitoring so you can understand what’s happening when a pipeline runs and how to troubleshoot when it doesn’t. Along the way, you’ll pick up best practices for organizing pipeline work, keeping it maintainable, and avoiding common mistakes that lead to broken refreshes or inconsistent outputs. By the end, you’ll have a strong starting framework for building dependable pipelines in Fabric.
Course Outline ( Free Preview)
Module 01 - Introduction
Nick introduces what Fabric Pipelines are designed to solve and how they fit into a modern Fabric workflow. You’ll get a clear view of what you’ll build in this course, how pipeline activities work together, and what “good” looks like when you’re aiming for repeatable, reliable data movement. This module sets expectations and gives you the mental model you’ll use for every activity that follows.
Module 02 - Core Fabric Pipeline Components
Learn the foundational pieces that make up a Fabric pipeline, activities, connections, datasets, and the flow that links steps together. Nick explains how pipelines execute, how to pass data between steps, and where monitoring and run history fit in. By the end, you’ll understand how to read a pipeline like a workflow diagram and troubleshoot issues at the right layer.
Module 03 - Pipeline Expressions and Parameters8 min.
This module shows how to make pipelines dynamic instead of hard-coded. You’ll learn what expressions and parameters are, why they matter, and how they help you reuse the same pipeline across environments, folders, or file names. Nick walks through common patterns for building flexible logic that adapts at runtime and keeps your pipeline maintainable.
Module 04 - Copy Data Activity14 min.
Get hands-on with one of the most important pipeline activities, Copy Data. Nick demonstrates how to move data from a source to a destination, map fields, and validate results. You’ll also learn practical tips for handling common issues like schema changes, authentication, and performance considerations.
Module 05 - Get MetaData Activity7 min.
Use Get MetaData to inspect files, folders, and datasets so your pipeline can make smarter decisions. Nick shows how to pull information like file lists, timestamps, and structural details, then use that output in later steps. This is a key building block for automated ingestion patterns that respond to what’s actually available.
Module 06 - Lookup Activity13 min.
Learn how to retrieve a value or small dataset to drive logic in your pipeline. Nick covers common uses like reading control tables, fetching configuration values, and pulling lists of items to process. You’ll see how Lookup helps make your workflows more data-driven and less manual.
Module 07 - Filter Activity11 min.
Filter activity helps you narrow down lists and work only with what matters. Nick demonstrates how to apply conditions to arrays, such as file lists or query outputs, so your pipeline processes the right records. This module focuses on building clean, readable logic that prevents wasted runs and unexpected results.
Module 08 - For Each Activity12 min.
Scale your pipelines by looping through collections using For Each. You’ll learn how to process multiple files, tables, or entities in one pipeline run, while keeping execution organized. Nick covers key configuration choices like sequential vs parallel runs and shows how to avoid common looping pitfalls.
Module 09 - Invoke Pipeline Activity1 min.
Build modular, reusable workflows using Invoke Pipeline. Nick shows how to break large processes into smaller pipelines, call one pipeline from another, and pass parameters between them. This approach improves maintainability and makes it easier for teams to standardize ingestion patterns.
Module 10 - Stored Procedure Activity2 min.
Use Stored Procedure activity when you need database-side logic as part of your pipeline. Nick walks through calling a stored procedure, passing parameters, and validating outputs. You’ll learn when stored procedures are a good fit, and how to use them responsibly so your pipeline stays transparent and debuggable.
Module 11 - Scheduling a Pipeline and Class Wrap Up8 min.
Finish by learning how to schedule pipelines so they run automatically on a cadence that fits your business needs. Nick shows where scheduling lives, what to monitor, and how to confirm success over time. The module wraps with a recap of core activities and a practical next-step checklist for building real pipelines confidently.
Nick has been a dedicated trainer and consultant since 2018, leveraging his extensive experience working with major companies, including Fortune 200 corporations, professional sports organizations, government entities, and leading firms in the finance and healthcare sectors. With a specialized focus on Power BI and data engineering, Nick has consistently demonstrated his ability to drive data-driven decision-making and optimize business processes. His commitment to excellence and his in-depth technical expertise have made him a trusted advisor and sought-after expert in the industry.
