Topic

AI Workflow Orchestration

All digests tagged AI Workflow Orchestration

Engineers… Your Software Factory NEEDS Agent Sandboxes to SCALE (exe.dev) thumbnail

· 37:15

Engineers… Your Software Factory NEEDS Agent Sandboxes to SCALE (exe.dev)

The video argues that traditional methods of running AI agents—such as allocating a small corner of a local machine or relying solely on containers/CI/CD—create bottlenecks. To achieve true scale and autonomy in an 'AI developer workflow' (ADW), the entire software factory must be moved into dedicated, isolated agent sandboxes (e.g., using exe.dev). This architecture enables complex workflows like running 'Best of N' comparisons across multiple model configurations while maintaining zero blast radius via disposable keys.

Key takeaways

  1. The Bottleneck Problem

    If an engineer is 'in the loop,' they are the bottleneck. True scaling requires moving beyond local compute limitations by giving every agent its own isolated computer, achieving isolation, scale, and autonomy.

  2. Three-Tier Architecture for Scale 23:25

    The recommended architecture involves an Out-loop orchestrator (on the engineer's machine), an In-sandbox orchestrator (on each VM), and the core Software Factory/ADW agents running inside the sandbox. This allows the top-level agent to kick off work and then go quiet, only requiring human intervention at planning and reviewing stages.

  3. Best of N Pattern 17:05

    Sandboxes enable running 'Best of N' patterns by simultaneously executing the same prompt/workflow across multiple agent configurations (e.g., Default, Frontier, Deepest, Open Weights), allowing for comparison and selection of the optimal outcome.

  4. Security and Isolation 27:50

    Sandboxes provide critical security by ensuring a 'bounded blast radius.' Agents use ephemeral resources, such as OpenRouter provisioning keys with hard spend caps, which are revoked upon teardown, preventing unauthorized access to production systems (e.g., AWS).

Watch on YouTube Full article

Tau Crash Course: The Python Port of Pi thumbnail

· 25:04

Tau Crash Course: The Python Port of Pi

Tau is a Python-based coding agent harness designed as an architectural port of Pi, aimed at standardizing and enhancing reliable AI workflow development. It features a Textual TUI for interaction and maintains core functionality like session management, tool calling (read, write, edit, bash), and skill invocation. Key technical aspects include the ability to store sessions in a JSONL format for easy analysis and integration into larger build pipelines.

Key takeaways

  1. Architectural Porting

    Tau is a coding harness developed entirely in Python and functions as an architectural port of Pi, ensuring core functionality remains consistent while updating the user interface.

  2. TUI Framework

    The Terminal User Interface (TUI) for Tau is built using Textual, which results in some differences from Pi's native TUI but maintains similar command structures.

  3. Session Management and Tree Structure 13:39

    Sessions are stored as a tree structure, where every message points to its parent ID. This allows users to fork conversations or navigate history using the `/tree` command.

  4. Data Export for Analysis

    Sessions can be exported into a JSONL format (JSON Lines), making them easily parsable for external analysis, skill testing, and integration with other agents.

Watch on YouTube Full article