-
Metadata-Driven Control Table in Fabric: What a Row Holds
Video on what one row of a metadata-driven pipeline's control table holds (source object, target table, layer, full or incremental load, watermark column, active flag), plus the source-systems and run-log tables around it. The rows live in a SQL database in Fabric, a variable library holds the environment settings, and the rows are scripted into Test and Prod as code.
-
Fabric Incremental Load: Watermark and Log Table, Step by Step
Video stepping through one incremental-load iteration of a metadata-driven pipeline in Fabric: read the old watermark, read the new one first, copy the range between them, write the watermark only after success, and log every iteration. Also points out that a watermark never sees deletes.
-
Materialized Lake Views for Files: Bronze in One Statement
Video on file ingestion with Materialized Lake Views (preview): one SQL statement turns a folder of CSV or Parquet files in OneLake into a bronze table, with no pipeline or notebook in front of it. Covers when it fits, when it doesn't (database or API sources, Python logic, sub-second updates), and edge cases such as paths with spaces and nested folders under shortcuts.
-
What Is FMD? Erwin de Kreuk's Fabric Metadata-Driven Framework
Video introducing FMD, Erwin de Kreuk's open-source (MIT) Fabric Metadata-Driven Framework. It loads source tables through a landing zone (files), Bronze (current state) and Silver (full history), driven by rows in one configuration database, and stops at Silver, so the Gold model is yours to build.
-
How FMD by Erwin de Kreuk Loads a Fabric Table: Landing to Silver
Video following one table (Orders) through FMD, Erwin de Kreuk's Fabric Metadata-Driven Framework, from source to Silver: one orchestrator pipeline runs the three layers in order, views generate the queries, queues sit between the layers, and the watermark is stored only after the queue step.
-
FMD by Erwin de Kreuk: How to Add a New Source Table in Fabric
Video on adding a new source table to FMD, Erwin de Kreuk's Fabric Metadata-Driven Framework: you add rows to the integration schema of its configuration database (a connection, a data source and three rows) rather than editing a pipeline, and the execution and logging schemas handle the rest, with credentials kept in Fabric.
-
FMD by Erwin de Kreuk vs Fabric Copy Job: Limits, When Not to Use It
Video comparing FMD, Erwin de Kreuk's open-source Fabric Metadata-Driven Framework, with Fabric's Copy job: use Copy job first where its CDC and SCD Type 2 support covers your sources, and FMD when you want a table registry and history without CDC. Also notes that incremental loads can't see deletes and that you run FMD yourself.
-
Connect coding agents to Fabric notebooks with FNTK (Preview)
The Fabric Notebook Toolkit (FNTK, preview) is a command-line tool that lets coding agents such as Claude Code, GitHub Copilot CLI and Codex find Fabric notebooks, read and edit cells, run one cell at a time in a live session, and pull back cell output, Spark job state and driver, executor and Livy logs for debugging. It installs from PyPI.
-
Announcing workspace monitoring integration for Fabric Data Warehouse (Preview)
Fabric Data Warehouse now integrates with workspace monitoring (preview). Completed, user-initiated queries from warehouses, SQL analytics endpoints and warehouse snapshots land in a WarehouseExecutions table in the workspace's monitoring KQL database, so you can compare query durations, find recurring failures, and use OperationId to jump to the matching Query Insights record.
-
Simple Report Bursting With Fabric Dataflows Gen2
Chris Webb combines the new Send Email action in Dataflows Gen2 with parameterised dataflows and a pipeline ForEach loop to send a personalised email to each recipient. He finds it slow, and it fails if the loop runs concurrently, so it only suits a handful of emails until HTML email bodies arrive (on the roadmap).
-
From mixed events to real-time action: Fabric Eventstreams Q3 2026
Eventstreams' Q3 2026 roundup. Now generally available: SAP Datasphere, Cribl, Solace PubSub+ and MQTT connectors; Mirrored Database Change Feed and MongoDB CDC connectors; Schema Registry and Event Schema Sets; and Activator rule management. In preview: Custom Stream Connector (Kafka Connect), schema-aware Eventstreams, Reference Data joins with Delta tables, Workspace Monitoring, a Capacity Operation Events source, workspace-level Private Link, Variable Library support and Copy Job support.
-
Explore and process multiple event types with Schema-aware Fabric Eventstreams (Preview)
Schema-aware Eventstreams (preview, new Eventstreams only) lets one stream carry several event types, whether they use registered schemas, are classified by a field such as deviceType, or are untyped. A redesigned data preview shows each event shape, and operators and destinations can then work on a single event type.
-
Incrementally migrate and re-migrate database objects with Migration Assistant for Fabric Warehouse (Preview)
Migration Assistant for Fabric Data Warehouse now supports incremental migration (preview): move database objects in phases into an empty, previously migrated or existing Warehouse, resolving name clashes side by side. Sources are SQL Server, Azure Synapse dedicated SQL pools and Teradata. Only object definitions are migrated; data loading is a separate step, for example with a copy job.
-
Simplify Teradata migrations with Fabric Migration Assistant (Preview)
Fabric Migration Assistant for Data Warehouse now supports Teradata sources (preview). It converts .sql and BTEQ files uploaded as a ZIP into Fabric-compatible T-SQL for tables, views, stored procedures, SQL functions and macros, lists anything that needs fixing, and Copilot can suggest corrections. Data is loaded separately, using a copy job, COPY INTO or pipelines.
-
More expressive graph analysis: GQL improvements in Microsoft Fabric Graph
The January-August 2026 updates to GQL in Microsoft Fabric Graph introduce features like ANY SHORTEST for shortest paths, quantified edge patterns for conditional traversals, and unbounded variable-length paths, enabling more precise control over graph queries and analysis of complex connections.
-
T-SQL language enhancements in Microsoft Fabric Data Warehouse (Preview)
Fabric Data Warehouse adds four T-SQL language enhancements in preview: GROUP BY ALL, ORDER BY ALL, the QUALIFY clause for filtering on window-function results, and a source-first FROM … SELECT query format.
-
New analytical functions in Microsoft Fabric Data Warehouse (Preview)
Fabric Data Warehouse and the SQL analytics endpoint gain MEDIAN, QUANTILE, APPROX_MEDIAN and APPROX_QUANTILE in preview, usable as aggregate or window functions. The existing PERCENTILE_CONT and PERCENTILE_DISC functions now also support aggregate syntax.