How To Turn Evals Into A Better Model
Before fine-tuning an LLM, focus on optimizing your evaluation environment. The three core parts of any eval are the Task Set, the Harness (the execution loop), and the Scoring Function. Advanced training involves Reinforcement Learning (RL).
Read article