AI Evals September 2026 cohort

How to Stop Building Products Nobody Wants

Continuous discovery emphasizes starting with a desired outcome, mapping unmet needs via Opportunity Solution Trees (OST), and using structured interviews to gather behavioral stories. AI accelerates synthesis and coaching, but rigor is key.

Read article

Hamel Husain

How to Cut Your LLM Classification Costs by 90%

This session details the Model Cascade architecture, a technique to drastically reduce LLM classification costs (by over 90%) while maintaining high accuracy (e.g., 95%+). Instead of running an expensive 'Oracle' model on every record, the cascade uses a cheap proxy model for initial predictions and only escalates to the Oracle when the proxy's confidence score is low. The optimal decision threshold ($\tau$) is found offline by simulating performance across samples.

Read article