Pragmatic Works Nerd News

Table Creation in Microsoft Fabric: How to Create Tables 10x Faster

Written by Manuel Quintana | Nov 18, 2024

In this video, Manuel Quintana from Pragmatic Works revisits the concept of shortcuts within Microsoft Fabric, specifically focusing on the differences between the files area (unmanaged) and the tables area (managed) in a Lakehouse environment. He explains how users can leverage shortcuts to bring external data into their Lakehouse and outlines the key steps for setting up tables using Delta-formatted data.

 

Overview of Shortcuts in Microsoft Fabric

Shortcuts in Fabric allow users to create connections to external data sources such as Azure Data Lake Storage or Amazon S3, bringing that data directly into the Fabric Lakehouse. Manuel emphasizes the distinction between the files area, which is unmanaged and suitable for various file types like Parquet, and the tables area, which is a managed section where Delta-formatted tables are created.

Steps to Create a Table Using a Shortcut

To create a table in the tables area using a shortcut, follow these steps:

  1. Navigate to the Lakehouse in Microsoft Fabric, where you will see both the files area (unmanaged) and the tables area (managed).
  2. Click on the "New Shortcut" option within the tables area.
  3. Select the external data source, such as Azure Data Lake, and input the necessary connection details (e.g., URL and SAS token).
  4. Choose the Delta-formatted data you wish to bring into the Lakehouse and assign a name to the table.
  5. Once the shortcut is created, the table will appear in the Lakehouse with a paperclip icon indicating it is a shortcut.

Using the New Table

After creating the table, users can interact with it as they would with any other table in their Lakehouse. Manuel demonstrates how to write SQL queries to query the data and how to join it with other tables. He shows that this table is fully integrated with the Lakehouse’s SQL endpoint, making it easy to query and model the data.

Practical Use Cases

Manuel highlights that the use of shortcuts in the tables area is especially useful when working with Delta-formatted data, as it allows users to manage their data efficiently within the Fabric environment. If the data is not in Delta format, it should be stored in the files area of the Lakehouse. This ensures that the data can be queried and used seamlessly across various aspects of the Lakehouse.

Conclusion

Shortcuts in Microsoft Fabric provide a quick and efficient way to integrate external data into your Lakehouse. By following a few simple steps, users can create Delta-formatted tables and use them in queries and models, streamlining their data workflows. 

Don't forget to check out the Pragmatic Works' on-demand learning platform for more insightful content and training sessions on Microsoft Fabric and other Microsoft applications. Be sure to subscribe to the Pragmatic Works YouTube channel to stay up-to-date on the latest tips and tricks.