Lada Kesseler: I Trust AI Tests Less Than AI Code
Summary
Lada Kesseler discusses advanced agentic workflows, arguing that achieving quality with AI agents requires structured 'loop engineering' rather than expecting perfect first attempts. She emphasizes giving agents explicit missions to disagree with and recommends techniques like iterative refinement (the 'centrifuge') and using specialized skills (like TDD) via front matter activation. For build engineers, the core message is shifting from monolithic code generation to modular, verifiable processes that manage complexity through deterministic triggers and layered testing.
Key takeaways
-
The Centrifuge Principle
11:39
Quality requires iterative refinement; do not expect AI-generated output to be perfect on the first try. The process involves taking one step, committing it to a file, reading it back, identifying flaws, and repeating the loop until satisfactory (00:13:09).
-
Agent Ground Rules are for Agents, Not Humans
10:22
The 'ground rules' or system prompts must give the model a mission to disagree with you (e.g., 'Don't try to please me') rather than just listing best practices. The description field in an agent skill is intended for machine activation, not human readability (00:10:02).
-
Sketch Prototypes with Markdown
20:43
For early-stage architecture or complex problem spaces, replace code with a markdown file and an agent. This allows the user to experience the workflow's user experience without committing to production code, serving as a fast, low-fidelity prototype (00:20:43).
-
Deterministic Verification is Key
27:28
Use 'verifiers' or deterministic triggers that check for specific standards (e.g., long methods, adherence to style guides) across various files, providing far better results than a single general code review prompt (00:35:29).
Technical details
-
Refinement Loops
699s
The 'centrifuge' process involves iterative refinement where the agent drafts content/code, which is then read back and corrected multiple times by human input to achieve quality (00:13:09).
-
Agent Skill Activation
773s
Skills should be activated using specific front matter within the skill definition, allowing the agent to determine when to use them automatically, rather than relying on generic context stuffing (00:25:48).
-
Testing Strategy (TDD/BDD)
1457s
For agents, TDD tests serve as a cross-check against reality. For high-level system validation, BDD (Behavior Driven Development) level tests are preferred over highly detailed unit tests like Cucumber to maintain scannability and focus on domain language (00:38:21).
-
Architecture Planning
1547s
When tackling complex systems, prioritize understanding the problem space before jumping into solutions. Consider using techniques like event sourcing or modeling processes via diagrams to manage complexity and prevent over-commitment to a single file structure (00:39:26).
Mentioned resources
- Tessl
- Claude.md (Ground Rules)
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.