Browse Machine Learning Roundups (13)

Microsoft introduced Project Osmos for Fabric, which coordinates data engineering agents and runs persistent PySpark tasks after local assistants disconnect, with execution governed by user permissions and Fabric capacity consumption. OneLake catalog's Govern experience became generally available, centralizing estate-wide oversight, while preview policies add explicit controls over who can edit governed workspace settings. Paid GitHub Copilot users in VS Code can now choose low, medium, or high eagerness for Next Edit Suggestions, balancing smaller interruptions against more extensive proposed edits. Fabric Data Warehouse added preview Python function calls from T-SQL and workspace-level query monitoring, while local Qwen3.8-27B testing showed that higher request concurrency can reduce completed agent work. Together, these developments emphasize persistent agent execution backed by access controls, runtime monitoring, and workload-specific tuning.

Welcome to this week's ML roundup, covering confidential virtual machines on Azure Local, GPU-accelerated Fabric queries, and updates to Fabric's data and coding agents. We examine the upcoming query-generation rollout and November 6 Foundry integration migration deadline, then explore interactive visualizations, retrieval grounded in business data, and GPU memory profiling. Research reports highlight human-directed agents and explicit verification, while data-platform updates bring practical considerations for schemas, migrations, transactions, and governance, with availability and limitations distinguished throughout.

This week's ML roundup focuses on the operational details that make data and AI systems reliable: consistent governance, predictable performance, and measurable evaluation. Azure Databricks reached GA with cross-engine ABAC for external Spark reads, while Microsoft Fabric added new ingestion paths, workload isolation controls, real-time event governance, and stronger admin recovery and network boundaries. On the infrastructure side, practical guides dug into GPU-enabled Kubernetes setups and efficient model serving on H100 Spot VMs with observability and KV-cache tuning. We also saw a push toward structured, testable model behavior with Olive and ONNX, plus real-world decision loops in F1 simulations and research on student simulators as eval harnesses and RL reward signals.

This week's ML roundup focuses on making scalable ML and agentic systems easier to operate inside governed Azure environments. We cover Anyscale on Azure reaching GA for Ray workloads on AKS with enterprise controls, plus Azure Databricks updates that target high-volume data movement, orchestration clarity, and cost visibility. On the analytics side, Fabric and OneLake guidance ties agent reliability to governed semantics and retrieval (RAG), while performance and architecture notes highlight ways to reduce load on operational systems and keep feedback loops fast.

This week's ML roundup centers on a practical shift toward governed, inspectable AI systems where semantics, permissions, and operational telemetry live close to the data. Microsoft Fabric doubled down on being the context and governance layer for Copilot and custom agents (via Fabric IQ, ontologies, OneLake controls, and scale tooling), while Azure SQL brought DiskANN-based vector indexing to GA to simplify retrieval next to transactional data. On the model side, Azure AI Foundry Model Router put measurable economics (quality, cost, latency) into routing decisions, and Azure Databricks highlighted unified pipelines, SQL-first AI decision patterns, and cost visibility. We also saw science-focused agent work (Microsoft Discovery and Research Quine) that treats reproducibility, tool traceability, and validation checkpoints as non-negotiable design requirements.

This week in ML, the focus shifted toward running agent workflows closer to the data tier, with SQL-driven agentic RAG and chat completion patterns that bring prompts, tool calls, and logging under existing database security and auditing. We also saw practical guidance on agent isolation and durable memory using Azure AI Foundry with Azure Blob Storage, plus production-oriented debugging considerations when agents run as long-lived services. On the applied side, Microsoft Discovery highlighted a human-in-the-loop, multi-agent approach to wastewater metagenomics that keeps reproducibility and reviewability central. Rounding out the week, platform updates covered the operational plumbing that hybrid analytics and agent-backed pipelines depend on, including gateway improvements and expanded observability for Oracle AI Database@Azure.

This week's ML roundup focuses on how data agents are getting closer to production standards, from Fabric IQ and MCP-grounded Copilot Studio experiences to Databricks Genie evaluations that run as a continuous quality loop. On the platform side, Fabric shipped updates that reduce migration risk (BigQuery mirroring GA and an ODBC inventory tool for the ADBC cutover) and improve day-2 operations with bounded, read-only natural-language diagnostics for Fabric Data Warehouse. We also look at Azure's MLPerf Inference v6.1 results for DeepSeek-R1 on NVIDIA GB200 and GB300 systems, plus smaller governance and integration updates across Databricks and Fabric.

This week's ML roundup focuses on making AI systems more reliable by tightening the connection between governed data and agent grounding, from Fabric's lineage-first item relations API to table-level discovery in OneLake Catalog search. We also saw practical Spark work that pushes latency down and correctness checks earlier, including Structured Streaming real-time mode for fast quarantine and native JSON parsing in Fabric's Native Execution Engine. Finally, three production case studies (supply chain planning, closed-loop lab discovery, and feedback-to-work-item automation) show what agentic systems look like when they ship with traceability, safety controls, and human review.

This week in Machine Learning, the focus shifts from prototypes to production guardrails, with Fabric data agents now generally available in Copilot Studio and new preview work on advanced DAX generation for semantic models. Fabric governance tightened with workspace outbound access controls, tenant-wide networking policy auditing, and connection recency signals that help reduce stale and single-owner risk. On data movement and interoperability, teams get clearer paths for private connectivity (Snowflake, Eventstream) and a GA transition from ODBC to ADBC that is worth validating early, while platform operations mature through capacity telemetry in Real-Time Hub and new CI/CD guidance to standardize deployments.

This week in ML and data engineering, Microsoft Fabric pushed further on standardization and operability with Runtime 2.0 (Spark 4.1 and Delta Lake 4.2), a GPU query acceleration preview, and more policy-driven OneLake governance, including a preview mirror of Google Lakehouse Runtime Catalog metadata for Iceberg tables. On the workflow side, Fabric Warehouse CI/CD moved closer to familiar database project patterns with DacFx and a VS Code Schema Compare path, while agent updates (including GPT-5.1 references and MCP-based connections) continued the shift from assisted authoring to tool-connected automation that still needs validation and logging. Rounding out the week, new guidance focused on practical cost loops in Azure Databricks and on building AI-ready apps with vector search and RAG in Azure SQL Database, plus a broader view of how Work IQ, Foundry IQ, and Fabric IQ frame RAG as the grounding layer for enterprise agents.

This week's ML roundup focuses on making agent experiences more governed and repeatable in Microsoft Fabric, from the new Fabric Data Warehouse MCP Server preview to tighter routing controls for Fabric data agents. On the data platform side, Fabric Data Warehouse added new tuning and cost tools, including GPU-powered Query Acceleration and Custom SQL Pools, plus practical guidance for Bronze-Silver-Gold layering. Security and operations also moved forward with CMK REST APIs, identity-based Event Hubs connections for Eventstream, and more production-friendly monitoring and dashboard KPIs to help teams run streaming workloads with clearer controls.

This week's ML roundup spans practical platform work and model-facing guidance, from Fabric Runtime 2.0 reaching GA for Spark workloads to new Lakehouse targets for dbt jobs and better near real-time capacity monitoring in Real-Time Hub. On the application side, the RAG guidance makes a clear point: vector search is only candidate generation, and rank fusion plus reranking determine what your system actually uses. We also look at production-focused inference improvements on AKS with NVIDIA Dynamo and Blob Storage integrations, and a research update on CARE-X that combines vision-language modeling with calibration, grounding, and tool-augmented measurement for radiology workflows.

This week in machine learning, Microsoft Fabric focused on making data and events easier to reuse across analytics and ML pipelines, from OneLake mirroring previews (Azure Monitor Log Analytics and AWS Glue-cataloged Iceberg) to more end-to-end streaming options with Change Event Streaming, Eventhouse, and clearer event architecture guidance. On the operations side, Fabric added practical safeguards and runbook improvements with Item Recovery becoming the default, a new VNet gateway evaluation engine preview, and scheduled User Data Functions for managed recurring logic. We also got concrete agent-building guidance with Microsoft IQ MCP endpoints across web, work, Fabric, and Foundry, and Microsoft Research released PRISM2 pathology foundation model weights on Hugging Face for research and benchmarking.