Browse Machine Learning News (116)

shilmenon describes expanded Microsoft Fabric mirrored catalog support for Azure Databricks materialized views and streaming tables. Fabric provides read-only access without copying data, while Databricks retains ownership of source processing. The update covers external-access prerequisites, catalog synchronization, SQL querying, and Power BI reporting through Direct Lake.

bytecascade explains how Reference Data Join in Microsoft Fabric Eventstream enriches live telemetry with context from OneLake Delta tables. A cold-chain example demonstrates visual and SQL joins, reference-data refresh intervals, and downstream routing, while outlining the trade-offs between enriching events in motion and joining them after ingestion.

tompeplow demonstrates how OneLake supports agent-driven data engineering through hosted MCP servers, endpoint discovery, and shortcuts. Using GitHub Copilot, the examples explore mirrored databases, document permissions, combine external data in a Lakehouse, and run SQL and Spark analytics while working within existing access permissions.

grakhra compares Microsoft Fabric integration options for Snowflake and Databricks, explaining when to use mirroring, OneLake shortcuts, shared Iceberg storage, or pipelines. The guide distinguishes replication from in-place access and outlines how Fabric data agents connect governed analytics data to custom experiences in Copilot Studio and AI Foundry.

Yun Jung Choi explains how six specialized Azure plugins extend AI-agent workflows for AKS troubleshooting, cost analysis, Advisor recommendations, graph queries, Azure Local, and Foundry IQ knowledge bases. The guide includes example prompts, installation commands for supported clients, and approval requirements for resource changes and disruptive operations.

MichalBar explains how Copilot in Microsoft Fabric generates editable Real-Time Dashboards from natural-language descriptions and Eventhouse data. The preview workflow lets users refine a dashboard plan before creation, then inspect queries and customize visuals. A stadium example connects transit arrivals with gate activity and queue lengths.

spurthikommajos explains how Microsoft Fabric Eventstream’s preview support for workspace-level private connectivity lets custom applications publish events without public internet access. The article covers Azure private endpoints, workspace-scoped network restrictions, setup prerequisites, and supported analytics destinations, including important capacity requirements and ingestion limitations.

yaelbiss explains how Microsoft Fabric’s preview Allow workspace settings editing policy restricts sensitive encryption and networking changes without removing workspace administrator responsibilities. The article covers security-group-based rules, development and production boundaries, audit logging, and allow-list behavior that administrators should test before activating policies across a tenant.

spurthikommajos introduces preview support for variable libraries in Microsoft Fabric Eventstream. Connection and item references let teams reuse eventstream definitions across development, staging, and production, while each workspace supplies its own resource values. The article explains configuration steps, deployment prerequisites, and how references remain intact through Git integration and deployment pipelines.

amitch and Shehab Amin explain how Sail connects Spark-compatible workloads to Microsoft OneLake without copying data. They demonstrate lakehouse transformations, Python-based embedding generation, and scoped access through LakeSail Cloud Sessions, while outlining compatibility checks and limitations of the reported performance and cost comparisons.

amitch and coauthor Iddo Avneri explain how Microsoft OneLake shortcuts expose lakeFS-managed data in Microsoft Fabric without copying datasets. Branch-following shortcuts provide current data, while commit-pinned shortcuts preserve reproducible snapshots. The article covers connection configuration, Delta table queries, validation results, and the tested configuration’s read-only limitation.

nareshvenkat introduces Project Osmos, a data engineering agent for Microsoft Fabric that investigates datasets, executes PySpark, and validates results. Persistent, shared tasks retain project context while teams define operating boundaries, review evidence, and guide changes. Tasks can be initiated through GitHub Copilot CLI, Claude Code, or Codex.

LeeBenjamin introduces the generally available Govern experience in Microsoft Fabric’s OneLake catalog and the new Govern Skills collection. Together, they provide centralized estate insights, policy controls, and AI-assisted governance checks, with evidence-based recommendations and confirmation before sensitive changes through tools such as GitHub Copilot.

SMATIN explains preview improvements to scalar user-defined functions in Microsoft Fabric Data Warehouse, including broader loop control and query support. Existing functions gain supported capabilities automatically, while new inlineability checks provide diagnostics and an explicit override for functions intentionally used without inlining.

Naorbt introduces generally available authoring capabilities for Microsoft Fabric Real-Time Dashboards. Design Tiles provide context and structure, multi-KPI displays related metrics from one query, and configurable KPI styles show values against thresholds and targets. The article explains how to combine these features into readable operational dashboards.

goupadhy outlines the October 2026 on-premises data gateway release for Microsoft Fabric, including accessibility fixes, preserved Power Query settings, and improved diagnostics. The update also introduces preview administration APIs for tenant-wide connection control and provides guidance for testing releases and upgrading production gateway clusters safely.

Alper explains how Microsoft Fabric’s preview React visualization libraries support analytics apps built with AI coding agents. Using Vega-Lite specifications and shared data, theming, and interaction contracts, the components provide reusable charts and grids with formatting, scrolling, tooltips, and consistent styling rather than requiring each app to recreate these behaviors.

sbaynes describes using the Microsoft Discovery app to adapt insect-monitoring systems for the Asian citrus psyllid, a pest that spreads citrus greening disease. The case study covers grounded AI agents, experimental design, permitting, and synthetic biometric data for preliminary edge classifiers, with scientists reviewing decisions throughout the workflow.

Mariyaali introduces preview support for Fabric Data Warehouse in workspace monitoring. Completed distributed queries flow into a workspace-scoped KQL database, where administrators can compare performance, investigate failures, and build dashboards. Shared query identifiers connect workspace telemetry to Query Insights for deeper investigation within the affected warehouse.

Ben Steenhoek and Ulugbek Abdullaev explain how configurable eagerness lets paid GitHub Copilot subscribers adjust inline suggestions in VS Code. They describe the low, medium, and high modes, the training approach behind them, reward-hacking mitigations, and experimental results showing how suggestion frequency and size change.

sbaynes introduces Flint-interactive, a language that helps AI agents generate interactive data visualizations (not just static charts) using high-level semantic events and update operators, so users can click, filter, zoom, and link interactions across charts, text, tables, and app state.

arindamc introduces Schema-aware Fabric Eventstreams (Preview), which lets Microsoft Fabric Real-Time Intelligence streams preserve event “shape” so teams can explore, classify, and process multiple event types in a single live stream without forcing everything into one wide schema.

MichalBar introduces a preview feature in Microsoft Fabric Real-Time Dashboards that uses Copilot to generate purpose-built custom visuals. By describing an operational question in natural language, dashboard authors can have Copilot create both the KQL query and an HTML-based visualization directly as a new dashboard tile.

sbaynes reports on Microsoft Research work proving the KLS conjecture, a long-standing result in high-dimensional geometry with implications for sampling, optimization, and randomized algorithms. The post also describes a human-directed, agentic AI workflow used to explore candidate proof paths and support derivations and verification.

prl explains the preview incremental migration workflow in Migration Assistant for Microsoft Fabric Warehouse, focusing on migrating database object definitions in phases, re-running migrations without recreating the destination, and handling naming conflicts safely. The post also clarifies how object migration differs from data loading and where Data Factory copy jobs fit in.

prl introduces the preview of Fabric Migration Assistant for migrating Teradata workloads to Fabric Data Warehouse, focusing on translating metadata and SQL/BTEQ into Fabric-compatible T-SQL, reviewing exceptions, and choosing practical data-movement and validation approaches to reduce manual migration effort.

QixiaoWang introduces the Fabric Notebook Toolkit (FNTK) preview, a CLI that lets coding agents interact with live Microsoft Fabric notebooks—reading and editing cells, running code, and pulling outputs and Spark diagnostics—so iterative debugging and validation can happen directly from an agent-driven terminal workflow.

Alicia Li summarizes Q3 2026 updates to Microsoft Fabric Eventstreams, focusing on new managed and custom connectors, CDC ingestion from operational databases, schema registry and schema-aware processing for mixed event types, in-flight enrichment with Delta tables, improved monitoring and diagnostics, and stronger deployment and networking controls.

tushar-msft summarizes January–August 2026 Graph Query Language (GQL) updates in Microsoft Fabric Graph, covering new path-finding and traversal controls, path inspection functions, multi-stage query composition, richer aggregation options, and added value/text functions (casting, ranges, Unicode normalization, and regex helpers).

jovanpop-msft announces four preview T-SQL enhancements in Microsoft Fabric Data Warehouse—GROUP BY ALL, ORDER BY ALL, QUALIFY, and the FROM ... SELECT query format—aimed at reducing repetitive SQL, simplifying maintenance when projections change, and making analytical query logic easier to read.

jovanpop-msft announces a preview update for Microsoft Fabric Data Warehouse and the SQL analytics endpoint: new and enhanced T-SQL analytical functions for distribution analysis, including exact and approximate median/quantile calculations and expanded percentile aggregate syntax.

jovanpop-msft introduces preview support for calling Fabric User Data Functions from T-SQL in Fabric Data Warehouse. The integration extends warehouse queries with custom Python logic for data enrichment, external API calls, and secret retrieval, with an example that calculates and stores IPv6 network prefixes for downstream analytics.

Amir Jafari announces the deprecation of the Fabric data agent “custom tool” integration in Microsoft Foundry and explains how to migrate to the Fabric IQ (OneLake Catalog) tool, including portal steps and an SDK/REST approach using MCP endpoints and Entra-based authentication.

midesa announces general availability of advanced NL2SQL and advanced DAX generation for Microsoft Fabric data agents, focused on improving query correctness for enterprise schemas. The post explains the agent’s explore-then-generate approach, new creator configurations (schema descriptions and topics), and internal benchmark results showing higher accuracy and lower latency.

sbaynes interviews Mercedes-AMG PETRONAS F1 lead race strategist Joey McMillan on how the team uses Microsoft Azure—especially Azure Batch—to run large-scale race simulations quickly enough to influence live, race-day strategy decisions under changing weather and track conditions.

t-dmarcovich1 introduces Fabric Policies (preview), a governance feature for Microsoft Fabric that lets tenant and capacity admins control which actions are allowed for specific users and workspaces, with centralized management and auditing.

sukkaur announces a preview feature that enables workspace-level Private Link connectivity for SQL database in Microsoft Fabric, aimed at tightening network access and reducing exposure by keeping database traffic on private networking paths.

hareshgowri announces a preview feature in Microsoft Fabric that lets you ingest CSV and Parquet files directly from OneLake into Materialized Lake Views, turning the bronze layer into a declarative step. The post shows the SQL syntax, schema modes, lineage tracking, and refresh options for building end-to-end medallion pipelines.

mk_sunitha introduces Fabric App functions (preview), a TypeScript-based serverless capability for Fabric Apps that lets builders run secure server-side logic, use application authentication to access downstream resources, and manage secrets safely. The post also shows how to scaffold, debug, and deploy functions, including using GitHub Copilot in VS Code.

sergeig888 announces the general availability of Microsoft Fabric “My workspace” governance improvements, including new admin REST APIs for granting and revoking temporary admin access and guidance for restoring orphaned workspaces after a user is deleted in Microsoft Entra ID.