The Video Signal

Topic

Evaluation Metrics

All digests tagged Evaluation Metrics

Wayve's Dave Kirk: Why Agentic Code Review Needs Evals thumbnail

· 23:55

Wayve's Dave Kirk: Why Agentic Code Review Needs Evals

Dave Kirk details Wayve's approach to agentic PR code review, emphasizing that reliable AI adoption requires moving beyond 'vibes-based' evaluation. The system uses a structured feedback loop—integrating sentiment tracking, usage metrics, and dedicated evaluations (Evals)—to improve prompts and guide multi-agent behavior in complex, high-stakes environments like self-driving car development.

Key takeaways

  1. Agent Reliability Requires Observability 2:08

    Multi-agent systems are stochastic and difficult to predict. Kirk notes that observability is critical; if a single agent's behavior cannot be observed, building reliable, production-ready multi-agent workflows is extremely challenging.

  2. The Pitfalls of Public Benchmarks 10:53

    Public coding benchmarks are often untrustworthy because agents can learn to 'cheat' the tests. Performance gains may simply reflect improved cheating mechanisms rather than genuine capability improvements.

  3. Structured Feedback Loops are Essential 22:30

    Wayve implements a feedback loop by collecting data on code review outcomes, including sentiment (thumbs up/down) and usage tracking. This data is used to identify common mistakes in prompts and improve agent behavior iteratively.

  4. The Value of Evals 23:25

    To ensure confidence, the team uses dedicated evaluation agents (Evals) that test the quality of output from other agents. Kirk highlights performing 'eval-driven development,' where the eval mechanism is built before the agent itself.

Watch on YouTube Full article

When Will The Benchmaxxing Plague End? — Nick Heiner, Surge AI thumbnail

· 17:25

When Will The Benchmaxxing Plague End? — Nick Heiner, Surge AI

The talk argues that the concept of 'benchmaxxing'—where models are trained excessively on benchmarks in ways that deviate from real-world utility—is rampant across AI. The speaker identifies several critical anti-patterns in benchmark creation, including contamination (memorizing test data), reward hacking, and misalignment between prompts and verifiers. Heiner advocates for a shift toward high-fidelity human evaluation, domain expertise, rigorous Quality Control (QC), and ensuring that benchmarks are aspirational artifacts reflecting true user needs rather than arbitrary scores.

Key takeaways

  1. Benchmaxxing is an industry problem

    The existence of 'benchmaxxing' indicates a gap between benchmark scores and real-world performance. This phenomenon is driven by incentives, poor methodologies, and the need for easily digestible metrics in a hyped market.

  2. Contamination is often default 7:21

    Contamination occurs when models memorize public questions and answers from the internet (e.g., Opus memorizing SWE-bench contents), making scores reflect recall rather than generalized ability.

  3. Verifiers must be fully aligned with prompts 10:23

    Misalignment between the prompt and the verifier (e.g., asking for no commas but accepting Hindi) or using hard-coded string matches introduces noise, leading to misleading scores.

  4. High-quality benchmarks require domain expertise

    Creating effective benchmarks requires not just technical experts (e.g., doctors for a medical benchmark) but also those with business and regulatory sense to understand the deployment environment.

  5. Human evaluation is necessary, despite cost

    The core value remains human preference. While expensive, maximizing quality requires paying for good workers rather than minimizing costs to achieve scalable metrics.

Watch on YouTube Full article