Agent Orchestration

Jul 17, 2026 · 39:02

Thinking Machines Lab drops Inkling & Meta’s Muse Spark 1.1

The AI landscape is shifting its focus from pure benchmark performance to customizable intelligence and architectural efficiency. This analysis covers three major model releases: Thinking Machines' open-weight Inkling (emphasizing customization via fine-tuning), Meta’s Muse Spark 1.1 (targeting cost-efficient agent workloads for enterprise use), and OpenAI's GPT-5.6 Sol, which showed progress on the challenging ARC-AGI-3 benchmark. Furthermore, Anthropic's J-space paper introduces a novel method to view internal model processing, offering potential new avenues for AI safety and control in agent development.

Key takeaways

1. Shift from Benchmarks to Customization

   The industry debate is moving away from which closed model is the 'best' toward utilizing open base models combined with robust fine-tuning platforms (e.g., Inkling/Tinker API) for tailored, customizable intelligence.

• IBM Technology
• Generative AI
• Large Language Models (LLMs)
• Mixture of Experts (MoE)
• AI Safety
• Agent Orchestration
• Mixture of Experts podcast page
• IBM AI Newsletter Signup

Watch on YouTube Full article

Jul 8, 2026 · 59:10

The Future of AI Infra: from Kubernetes to Agent Sandboxes — Akshat Bubna, Modal CTO

Modal CTO Akshat Bubna discusses how modern AI workloads—especially those involving agents and elastic inference—exceed the design capabilities of traditional cloud infrastructure like Kubernetes. Modal addresses this by providing a specialized, highly elastic platform built on primitives such as serverless functions, GPU snapshotting, private IPv6 networking, and RDMA support. The discussion highlights a critical shift from optimizing for Developer Experience (DX) to enabling Agent Experience (AX), where the infrastructure must support complex, bursty compute patterns like those found in RL rollouts or custom model deployment across multiple cloud providers.

Key takeaways

1. Shift from DX to AX 17:33

   Modal is shifting its focus from Developer Experience (DX) to Agent Experience (AX). This shift acknowledges that agents will increasingly operate on infrastructure, making the ability for an agent to self-provision and modify resources via decorators more valuable than manually writing complex YAML files in Kubernetes.

2. K8s Limitations for AI 4:19

   Traditional orchestration tools like Kubernetes were not designed for highly bursty, compute-heavy workloads common in AI. They struggle with the rapid scaling and specialized resource needs (like accelerators) required by modern models.

3. Elastic Inference & Autoscaling 21:00

   The platform excels at elastic inference for custom models (e.g., audio, video, robotics). The core challenge is managing unpredictable traffic patterns and scaling rapidly across different regions, a problem Modal addresses through its autoscaling primitives.

4. Advanced Performance Primitives 27:30

   To achieve frontier-level inference performance, Modal utilizes techniques like speculative decoding (using a smaller 'draft model' to predict tokens ahead of the main model) and DeFlash (a block-based speculator), achieving significant speedups without quality loss.

• Latent Space
• AI Infrastructure
• Serverless Computing
• Agent Orchestration
• High-Performance Computing (HPC)
• Cloud Networking
• Modal
• DeFlash
• speculative decoding
• Private IPv6

Watch on YouTube Full article