Topic
All digests tagged Model Evaluation
Suggested route
Move from earlier context through the available material to the newest signals. This route is a reading aid, not a difficulty ranking.
This workshop compares GPT-5.5, Kimi, DeepSeek, and Mistral across complex scenarios like RAG, tool calling, and vision. Learn how to use ASSERT and DSPy to automate model evaluation and optimize prompts for portability.
Read article
Learn how to build reproducible AI agent evaluation pipelines using WolfBench. Discover why single scores are insufficient and how to track consistency, cost, and capability across six critical pipeline layers.
Read article
Learn to cut AI costs by shifting focus from cost per token to cost per task. Discover advanced levers like Prompt Caching, Programmatic Tool Calling, and Batch APIs to optimize your AI workflows.
Read article
Jev, a new System 1 model from TypeSafe AI, is designed for fast, structured decision-making. It is up to 200x faster and 400x cheaper than LLMs for classification tasks, making it ideal for model routing and agent evaluation.
Read article
The video details building a verifier for LLM evaluation on math benchmarks. This robust pipeline involves extracting the final answer, normalizing the format, and using symbolic math libraries like sympy to verify mathematical equivalence for RL training.
Read article