Topic

Software Factories

All digests tagged Software Factories

How Software Factories Improve Themselves — Suraj Gupta, Warp thumbnail

· 12:52

How Software Factories Improve Themselves — Suraj Gupta, Warp

The presentation outlines three architectural patterns for building self-improving software factories: implementing outer-loop agents for skill refinement, utilizing persistent memory stores for traceable facts, and employing model routing to optimize cost and performance. These methods allow automated development environments to continuously improve their capabilities, moving beyond simple agent execution to self-optimization.

Key takeaways

  1. Outer-Loop Agents for Skill Improvement 6:55

    Instead of relying solely on an inner-loop agent to execute a skill (e.g., triage), an outer-loop agent observes the inner agent's runs and human feedback. Improvements to the skill are then formally tracked and reviewed via a Pull Request (PR) in Git, ensuring observability and preventing regressions. (4:15, 5:00)

  2. Persistent Memory as a Fact Store 8:55

    Persistent memory acts as a versioned, traceable fact store scoped to an agent (e.g., a Sentry agent). This allows future runs to leverage previously gathered root cause analysis or context, preventing the waste of tokens and time re-gathering known information. (5:35, 6:35)

  3. Model Routing for Cost Efficiency

    Model routing prevents excessive costs by preventing simple tasks (like triage or minor CI fixes) from running on high-cost models (e.g., Opus). Users can define custom rules or use auto-models to direct tasks to the most efficient model (e.g., using GLM for UI tasks). (8:45, 9:40)

Watch on YouTube Full article

AI Code Review That Understands Your PR's Intent thumbnail

· 5:30

AI Code Review That Understands Your PR's Intent

As coding agents write thousands of lines and open numerous PRs, the bottleneck shifts from writing code to reviewing and trusting it. Tessl Code Review addresses this by providing automated review capabilities that are aware of the Pull Request's (PR) intent, not just the diff. Key features include customizable 'review lenses' scoped via `globs` for specific standards (e.g., security or random design), ensuring accountability remains with the human reviewer while automating consistency across an organization's codebase.

Key takeaways

  1. The Shift in Bottleneck 0:35

    With agents writing code at scale, manual review and establishing trust in agent-written code is now the primary bottleneck. Reviewing becomes the critical 'final gate' (00:00:35).

  2. Intent-Aware Review 0:55

    Tessl Code Review differentiates itself by reading the PR summary and title to understand the intended goal of the change, allowing it to review according to context rather than just line changes (00:00:55).

  3. Customizable Review Lenses 2:03

    Review lenses are customizable skills that can be evaluated and distributed across a repository. They can be precisely scoped using `globs` to target specific sections of the codebase (e.g., security or random design) (00:02:03).

  4. Owning the Standard 3:14

    The review standard is defined by a versionable configuration file within the repository itself, ensuring that the team owns and controls the rules rather than relying on external web UI settings or black boxes (00:03:14).

Watch on YouTube Full article

Every Repo Is a Software Factory Now | Don Syme, GitHub thumbnail

· 1:04:36

Every Repo Is a Software Factory Now | Don Syme, GitHub

This talk explores the concept of 'Continuous AI,' defining it as an evolution that extends traditional Continuous Integration and Continuous Deployment (CI/CD) into subjective, automated activities like documentation updates and bug triage. The core mechanism for this is the use of GitHub Agentic Workflows, which run coding agents with strong guardrails within a bounded repository context. The discussion emphasizes that while AI offers incredible power, maintaining quality gates, controlling costs, and ensuring human oversight remain critical to building reliable 'software factories.'

Key takeaways

  1. Continuous AI vs. CI/CD 5:52

    Continuous AI extends the principles of CI/CD by applying automation to subjective activities (e.g., documentation, bug triage) that are not inherently deterministic like traditional build checks. It requires operationalizing these processes on a permanent basis [00:03:52].

  2. Bounding the Context is Key 10:42

    To prevent automated AI agents from 'going off the rails,' they must operate within a strictly bounded context (e.g., restricted to creating a single pull request or issue) [00:09:42]. This situates the automation, making it manageable and auditable.

  3. The Repo as the Unit of Production 13:59

    GitHub Agentic Workflows are designed around the repository being the primary unit of production and security boundary. This repo-centric approach aligns with established CI/CD principles while enabling advanced AI automation [00:25:19].

  4. Quality Gates and Human Review 5:12

    The focus shifts from human review as a bottleneck to creating automated, high-quality pull requests. The goal is to 'equip the reviewer' with all necessary information (e.g., performance evidence) to make informed decisions [00:52:01].

  5. Complexity Management 3:59

    For maintainers, a single supervisor orchestrator pattern workflow that can perform multiple tasks is preferred over an 'agent zoo' of many individual workflows. This simplifies maintenance and provides better cost control [03:59:00].

Watch on YouTube Full article