In this video from Pragmatic Works, Mitchell Pearson continues his Azure Synapse Analytics series by introducing one of the most flexible and cost-effective ways to query data in a data lake: SQL on-demand using serverless SQL pools. Building on prior discussions around Azure Data Lake, Mitchell shifts the focus toward how users can efficiently access and analyze stored data without provisioning dedicated resources.
Mitchell begins by explaining the two main types of SQL pools available in Azure Synapse Analytics:
While dedicated SQL pools are ideal for consistent, high-volume workloads, serverless SQL pools are better suited for ad hoc analysis, quick queries, and exploratory data access.
Mitchell highlights several key benefits of using SQL on-demand:
This makes serverless SQL pools especially appealing for organizations seeking cost-efficient analytics solutions without sacrificing performance.
Mitchell demonstrates how to access the Azure Synapse workspace through the web interface and navigate to the Data section. From there, users can:
This tight integration between Synapse and the data lake simplifies the data exploration process, allowing users to work seamlessly across services.
One of the most powerful features demonstrated is the ability to query files directly from the data lake using SQL. By simply right-clicking a file, users can generate a query such as:
Instead of querying traditional database tables, SQL on-demand uses the OPENROWSET function to access files like Parquet or CSV directly.
Mitchell emphasizes that this approach enables users to:
The demo highlights differences between file formats:
For CSV files, Mitchell demonstrates how to use options like HEADER_ROW = TRUE to correctly interpret column names. This illustrates the importance of understanding file structure when querying data.
Throughout the session, Mitchell shares practical tips to improve workflow and avoid common mistakes:
SQL on-demand is not limited to the Synapse workspace. Mitchell explains that it can also be integrated with:
This flexibility allows organizations to build end-to-end analytics solutions while leveraging the power of serverless computing.
Mitchell Pearson concludes by reinforcing the value of SQL on-demand as a game-changing feature in Azure Synapse Analytics. By enabling direct querying of data lake files with minimal setup and cost, serverless SQL pools empower analysts and developers to perform fast, scalable, and efficient data analysis.
As the series progresses, viewers can expect deeper dives into dedicated SQL pools, Spark, and advanced integration scenarios, further expanding their understanding of modern data platforms.
Don't forget to check out the Pragmatic Works' on-demand learning platform for more insightful content and training sessions on Azure Synapse Analytics and other Microsoft applications. Be sure to subscribe to the Pragmatic Works YouTube channel to stay up-to-date on the latest tips and tricks.