Home / Fabric / Microsoft Fabric - OneLake and Lakehouse
Microsoft Fabric - OneLake and Lakehouse
Gain comprehensive insights into Microsoft Fabric OneLake and LakeHouse with Manuel Quintana, covering SQL endpoints, workspaces, and lake house creation for effective real-world application.
In this class, led by Manuel Quintana, students will embark on an exploratory journey into the Microsoft Fabric OneLake and LakeHouse, gaining hands-on experience with the Fabric portal, workspaces, and the creation of lake houses. Manuel will guide participants through the intricacies of SQL endpoints, leveraging tools like SQL Server Management Studio to enhance understanding. The course aims to demystify the concepts of One Lake and Lake House, differentiating between the two and providing practical insights into their applications.
Course Outline ( Free Preview)
Getting Started
Module 00 - Introduction
Manuel Quintana introduces the Microsoft Fabric OneLake and LakeHouse course, focusing on navigating the Fabric portal, creating lake houses, and exploring SQL endpoints. He emphasizes the importance of hands-on experience with lake houses and related technologies, including SSMS and semantic models. Students are encouraged to prepare by downloading necessary resources and approaching the course with a readiness to learn about the evolving landscape of data management.
Module 01 - Introduction to OneLake
Manuel introduces the concept of Microsoft Fabric's OneLake and Lakehouse, emphasizing the foundational role of data lakes in building a unified data management architecture. He explains that One Lake serves as a centralized repository for all organizational data, supporting various file formats and enabling efficient data storage and access.
Module 02A - Introduction to Fabric Lakehouse20 min.
Manuel introduces the concept of Microsoft Fabric OneLake and LakeHouse, emphasizing their roles in data architecture for managing structured and unstructured data within a single location. He explains the Lake House as an initial point of interaction with Fabric, highlighting its flexibility and scalability in handling large volumes of data. Key terminologies include "One Lake," "Lake House," "Fabric artifacts," and "Delta tables," underscoring their significance in data storage and management.
Module 02B - Creating and Exploring a Lakehouse15 min.
Manuel guides you through the process of creating a Lakehouse in Microsoft Fabric OneLake, emphasizing the integration with Power BI for data management and analysis. He highlights the importance of understanding licensing, tenant level settings, and the straightforward nature of setting up a lake house, underscoring the critical terminology such as "lake house," "Power BI tenant," and "fabric artifacts." This tutorial serves as a practical step in leveraging Microsoft's data services for structured and unstructured data management within an organizational context.
Module 03A - Understanding the File Section20 min.
Manuel introduces the concept of a Lakehouse in Microsoft Fabric, focusing on the file section as an unmanaged area for data navigation, access, and management. He explains the distinction between managed and unmanaged areas, emphasizing the lake house explorer's role in providing a unified graphical representation for intuitive data interaction. Key terminologies include "lake house explorer," "managed area," and "unmanaged area," highlighting their significance in data management within the lake house framework.
Module 03B - Understanding the Table Section21 min.
Manuel guides students through the process of loading files into tables within Microsoft Fabric's Lakehouse Explorer, focusing on the transition from the File Explorer to the Table section. He emphasizes the importance of delta formatted tables and the managed section of the lake house, highlighting the ease of data analysis and organization. Key terminology includes "delta tables," "managed section," and "Lake House Explorer," underscoring the structured approach to data management and analysis.
Module 04 - OneLake File Explorer7 min.
Manuel introduces the OneLake File Explorer, a tool that integrates with Windows File Explorer to manage Lakehouses and Fabric workspaces directly from the desktop, without needing a browser. He demonstrates its installation, lightweight nature, and how it seamlessly syncs with OneLake items, providing a OneDrive-like experience for data management. Key concepts include the interaction with Fabric workspaces, the importance of syncing for up-to-date file management, and the application's limitations regarding file naming conventions due to case sensitivity differences between OneLake and Windows File Explorer.
Module 05A - Exploring The SQL Analytics Endpoint14 min.
Manuel introduces the SQL analytics endpoint within the Microsoft Lakehouse, emphasizing its role in querying delta formatted tables and managing data. He explains the limitations of SQL in this context, highlighting that it's primarily for read-only operations, with actions like insert and edit not supported. The video serves as a foundational guide for students to understand the structured query language (SQL) and its application in data analytics and management within the Lakehouse framework.
Module 05B - Exploring The SQL and Visual Queries29 min.
Manuel guides you through the intricacies of SQL and Visual Query Editor within Microsoft Fabric Lakehouse, emphasizing the power of T-SQL language and the ease of data manipulation and exploration. He demonstrates how to create views, interact with Excel, and generate Power BI reports, showcasing the seamless integration of data analysis tools. Key terminologies include SQL, T-SQL, Visual Query Editor, views, and Power BI, essential for understanding data querying and reporting in a Lakehouse environment.
Module 06A - Understanding the Default Semantic Model26 min.
Manuel discusses the integration of semantic models within Microsoft Fabric Lakehouses, emphasizing their role in enhancing data management and analysis. He highlights the importance of the SQL endpoint and the default semantic model in creating a comprehensive data ecosystem, where delta formatted tables and direct lake mode play crucial roles. Key terminologies for students to remember include "semantic model," "SQL endpoint," "delta formatted tables," and "direct lake mode."
Module 06B - Creating A New Semantic Model11 min.
Manuel discusses the process of creating a new semantic model within Microsoft Fabric's Lakehouse, emphasizing its simplicity and the considerations involved. He highlights the importance of selecting tables from the lake house to include in the semantic model and the need for manual adjustments, such as defining relationships and calculated measures, that do not automatically transfer from the default semantic model. The video serves as a practical guide on leveraging Lakehouse tables to customize semantic models, underscoring the significance of direct lake connections and the management of these models within the Power BI service.
Module 07 - Using Shortcuts in a Lakehouse16 min.
In this video, Manuel introduces the concept of shortcuts within Microsoft Fabric's Lakehouse architecture, emphasizing their role in seamlessly integrating external data sources without the need for data movement. He explains how shortcuts allow for the direct consumption of data from various storage systems, including Azure Storage and Amazon S3 buckets, into the lake house's SQL endpoint and semantic models. The critical terminologies to remember are "shortcuts," "lake house," "SQL endpoint," and "semantic models."
Module 08 - Access and Sharing23 min.
Manuel discusses the process of granting access and sharing in Microsoft Fabric Onelake and Lakehouse, highlighting the importance of understanding access nuances and the preview feature's potential changes. He emphasizes the significance of role-based access control and the impact of sharing permissions on the lake house's SQL endpoint, semantic model, and data management. Critical terminology includes "Lakehouse," "SQL endpoint," "semantic model," "CRUD operations," and "role-based access control."
Manuel Quintana has been teaching and developing training content for Pragmatic Works for the past 6 years. The areas of knowledge he has worked with includes the Microsoft SQL BI Stack (T-SQL, SSIS, SSAS, and SSRS), the Power Platform (Power BI, Power Automate, and PowerApps), and other various Azure services. Manuel has also authored a couple of books around Power BI and the Power Platform and participates within the community by presenting topics at various SQL Server or Power BI User groups.