Browse All Machine Learning Content (205)

shilmenon describes expanded Microsoft Fabric mirrored catalog support for Azure Databricks materialized views and streaming tables. Fabric provides read-only access without copying data, while Databricks retains ownership of source processing. The update covers external-access prerequisites, catalog synchronization, SQL querying, and Power BI reporting through Direct Lake.

bytecascade explains how Reference Data Join in Microsoft Fabric Eventstream enriches live telemetry with context from OneLake Delta tables. A cold-chain example demonstrates visual and SQL joins, reference-data refresh intervals, and downstream routing, while outlining the trade-offs between enriching events in motion and joining them after ingestion.

tompeplow demonstrates how OneLake supports agent-driven data engineering through hosted MCP servers, endpoint discovery, and shortcuts. Using GitHub Copilot, the examples explore mirrored databases, document permissions, combine external data in a Lakehouse, and run SQL and Spark analytics while working within existing access permissions.

grakhra compares Microsoft Fabric integration options for Snowflake and Databricks, explaining when to use mirroring, OneLake shortcuts, shared Iceberg storage, or pipelines. The guide distinguishes replication from in-place access and outlines how Fabric data agents connect governed analytics data to custom experiences in Copilot Studio and AI Foundry.

Yun Jung Choi explains how six specialized Azure plugins extend AI-agent workflows for AKS troubleshooting, cost analysis, Advisor recommendations, graph queries, Azure Local, and Foundry IQ knowledge bases. The guide includes example prompts, installation commands for supported clients, and approval requirements for resource changes and disruptive operations.

Emanuele Bartolesi recaps GitHub Universe 2026 through its two keynotes, connecting Copilot’s multi-repository workflows with review, security, and Git infrastructure changes. His practical takeaways focus on verification gates, contributor guardrails, shared planning, and keeping human judgment central as teams adopt coding agents.

Jason Farmer explains how industrial AI agents connect to real equipment through cloud and edge infrastructure. The architecture combines Azure IoT services, Kubernetes, Foundry Local, and Microsoft Fabric, with an on-site virtual coworker that continues operating when cloud connectivity drops.

MichalBar explains how Copilot in Microsoft Fabric generates editable Real-Time Dashboards from natural-language descriptions and Eventhouse data. The preview workflow lets users refine a dashboard plan before creation, then inspect queries and customize visuals. A stadium example connects transit arrivals with gate activity and queue lengths.

WSilveira collects November’s Azure Logic Apps product and community updates, including a local CLI preview, AI agent orchestration, pricing allowances, and hybrid storage benchmarks. The newsletter also points developers to secure Foundry integrations, C# workflow tooling, Fabric real-time analytics, deployment walkthroughs, and BizTalk migration guidance.

Microsoft introduced Project Osmos for Fabric, which coordinates data engineering agents and runs persistent PySpark tasks after local assistants disconnect, with execution governed by user permissions and Fabric capacity consumption. OneLake catalog's Govern experience became generally available, centralizing estate-wide oversight, while preview policies add explicit controls over who can edit governed workspace settings. Paid GitHub Copilot users in VS Code can now choose low, medium, or high eagerness for Next Edit Suggestions, balancing smaller interruptions against more extensive proposed edits. Fabric Data Warehouse added preview Python function calls from T-SQL and workspace-level query monitoring, while local Qwen3.8-27B testing showed that higher request concurrency can reduce completed agent work. Together, these developments emphasize persistent agent execution backed by access controls, runtime monitoring, and workload-specific tuning.

spurthikommajos explains how Microsoft Fabric Eventstream’s preview support for workspace-level private connectivity lets custom applications publish events without public internet access. The article covers Azure private endpoints, workspace-scoped network restrictions, setup prerequisites, and supported analytics destinations, including important capacity requirements and ingestion limitations.

yaelbiss explains how Microsoft Fabric’s preview Allow workspace settings editing policy restricts sensitive encryption and networking changes without removing workspace administrator responsibilities. The article covers security-group-based rules, development and production boundaries, audit logging, and allow-list behavior that administrators should test before activating policies across a tenant.

spurthikommajos introduces preview support for variable libraries in Microsoft Fabric Eventstream. Connection and item references let teams reuse eventstream definitions across development, staging, and production, while each workspace supplies its own resource values. The article explains configuration steps, deployment prerequisites, and how references remain intact through Git integration and deployment pipelines.

amitch and Shehab Amin explain how Sail connects Spark-compatible workloads to Microsoft OneLake without copying data. They demonstrate lakehouse transformations, Python-based embedding generation, and scoped access through LakeSail Cloud Sessions, while outlining compatibility checks and limitations of the reported performance and cost comparisons.

amitch and coauthor Iddo Avneri explain how Microsoft OneLake shortcuts expose lakeFS-managed data in Microsoft Fabric without copying datasets. Branch-following shortcuts provide current data, while commit-pinned shortcuts preserve reproducible snapshots. The article covers connection configuration, Delta table queries, validation results, and the tested configuration’s read-only limitation.

Patrick LeBlanc joins Anna Hoffman to demonstrate Database Agents in Microsoft Fabric, which detect SQL performance problems before they affect users. The episode covers Database Hub, configuration requirements, issue detection, and SQL Server Management Studio integration, alongside a longer-term vision for agents that learn from DBA interactions.

nareshvenkat introduces Project Osmos, a data engineering agent for Microsoft Fabric that investigates datasets, executes PySpark, and validates results. Persistent, shared tasks retain project context while teams define operating boundaries, review evidence, and guide changes. Tasks can be initiated through GitHub Copilot CLI, Claude Code, or Codex.

LeeBenjamin introduces the generally available Govern experience in Microsoft Fabric’s OneLake catalog and the new Govern Skills collection. Together, they provide centralized estate insights, policy controls, and AI-assisted governance checks, with evidence-based recommendations and confirmation before sensitive changes through tools such as GitHub Copilot.

SMATIN explains preview improvements to scalar user-defined functions in Microsoft Fabric Data Warehouse, including broader loop control and query support. Existing functions gain supported capabilities automatically, while new inlineability checks provide diagnostics and an explicit override for functions intentionally used without inlining.

Naorbt introduces generally available authoring capabilities for Microsoft Fabric Real-Time Dashboards. Design Tiles provide context and structure, multi-KPI displays related metrics from one query, and configurable KPI styles show values against thresholds and targets. The article explains how to combine these features into readable operational dashboards.

goupadhy outlines the October 2026 on-premises data gateway release for Microsoft Fabric, including accessibility fixes, preserved Power Query settings, and improved diagnostics. The update also introduces preview administration APIs for tenant-wide connection control and provides guidance for testing releases and upgrading production gateway clusters safely.

Alper explains how Microsoft Fabric’s preview React visualization libraries support analytics apps built with AI coding agents. Using Vega-Lite specifications and shared data, theming, and interaction contracts, the components provide reusable charts and grids with formatting, scrolling, tooltips, and consistent styling rather than requiring each app to recreate these behaviors.

Wuyi_Weng walks through running Qwen3.8-27B locally on a 64 GB Lenovo laptop using vLLM, speculative decoding, and OpenCode. Benchmarks and a three-hour coding session show how memory allocation and request concurrency affect performance, while Azure Monitor and Grafana track inference, GPU usage, and operational limits.

sbaynes describes using the Microsoft Discovery app to adapt insect-monitoring systems for the Asian citrus psyllid, a pest that spreads citrus greening disease. The case study covers grounded AI agents, experimental design, permitting, and synthetic biometric data for preliminary edge classifiers, with scientists reviewing decisions throughout the workflow.

Mariyaali introduces preview support for Fabric Data Warehouse in workspace monitoring. Completed distributed queries flow into a workspace-scoped KQL database, where administrators can compare performance, investigate failures, and build dashboards. Shared query identifiers connect workspace telemetry to Query Insights for deeper investigation within the affected warehouse.

Welcome to this week's ML roundup, covering confidential virtual machines on Azure Local, GPU-accelerated Fabric queries, and updates to Fabric's data and coding agents. We examine the upcoming query-generation rollout and November 6 Foundry integration migration deadline, then explore interactive visualizations, retrieval grounded in business data, and GPU memory profiling. Research reports highlight human-directed agents and explicit verification, while data-platform updates bring practical considerations for schemas, migrations, transactions, and governance, with availability and limitations distinguished throughout.

Ben Steenhoek and Ulugbek Abdullaev explain how configurable eagerness lets paid GitHub Copilot subscribers adjust inline suggestions in VS Code. They describe the low, medium, and high modes, the training approach behind them, reward-hacking mitigations, and experimental results showing how suggestion frequency and size change.

isaiahhoyer describes using Microsoft Discovery agents to adapt Microsoft Premonition biological monitoring systems for citrus pests. The case study covers grounding agents in engineering documents, designing field experiments, preparing permit requests, and generating synthetic wingbeat data for preliminary edge classifiers, with scientific review and human oversight throughout.

sbaynes introduces Flint-interactive, a language that helps AI agents generate interactive data visualizations (not just static charts) using high-level semantic events and update operators, so users can click, filter, zoom, and link interactions across charts, text, tables, and app state.

arindamc introduces Schema-aware Fabric Eventstreams (Preview), which lets Microsoft Fabric Real-Time Intelligence streams preserve event “shape” so teams can explore, classify, and process multiple event types in a single live stream without forcing everything into one wide schema.

MichalBar introduces a preview feature in Microsoft Fabric Real-Time Dashboards that uses Copilot to generate purpose-built custom visuals. By describing an operational question in natural language, dashboard authors can have Copilot create both the KQL query and an HTML-based visualization directly as a new dashboard tile.

Marko Hotti and Patty Chow demonstrate how to build a smarter AI travel planner on Azure Cosmos DB by combining operational app data with vector embeddings and search features, so the app can answer nuanced queries while still respecting real inventory and booking workflows.

madhurinrao explains ABFS Vectored Read for Azure Data Lake Storage and how it reduces request overhead for selective Parquet reads by coordinating noncontiguous byte ranges through the ABFS driver, enabling compatible Spark workloads to adopt the optimization via configuration.

Bruno Capuano and Luis Quintanilla explain how .NET’s AI building blocks fit together for real-world apps, focusing on data ingestion, embeddings, and vector search to ground LLM responses in your own documents and business data.

Wiliam_Rosa breaks down Azure Databricks multi-table, multi-statement transactions (GA as of Oct 16, 2026), explaining the two transaction modes, how conflict detection works, and why external clients need explicit retry logic to be reliable under real concurrency.

sbaynes reports on Microsoft Research work proving the KLS conjecture, a long-standing result in high-dimensional geometry with implications for sampling, optimization, and randomized algorithms. The post also describes a human-directed, agentic AI workflow used to explore candidate proof paths and support derivations and verification.

prl explains the preview incremental migration workflow in Migration Assistant for Microsoft Fabric Warehouse, focusing on migrating database object definitions in phases, re-running migrations without recreating the destination, and handling naming conflicts safely. The post also clarifies how object migration differs from data loading and where Data Factory copy jobs fit in.

prl introduces the preview of Fabric Migration Assistant for migrating Teradata workloads to Fabric Data Warehouse, focusing on translating metadata and SQL/BTEQ into Fabric-compatible T-SQL, reviewing exceptions, and choosing practical data-movement and validation approaches to reduce manual migration effort.

QixiaoWang introduces the Fabric Notebook Toolkit (FNTK) preview, a CLI that lets coding agents interact with live Microsoft Fabric notebooks—reading and editing cells, running code, and pulling outputs and Spark diagnostics—so iterative debugging and validation can happen directly from an agent-driven terminal workflow.

Ben Sickle outlines Microsoft’s announcements at NVIDIA GTC Berlin 2026 focused on running AI across Azure and customer-controlled environments, including Azure Local sovereign deployments, Foundry Local for on-prem model inference, confidential VMs, open-model endpoints for NVIDIA Nemotron via Fireworks AI on Azure, and GPU-accelerated analytics in Microsoft Fabric.