Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI
This talk details how a specialized, smaller Language Model (Qwen3 4B) was trained using Reinforcement Learning (RL) on a domain-specific dataset (FinQA) derived from SEC 10-K filings. The resulting model significantly outperformed its much larger, generalist counterpart (235B parameters) on complex financial question-answering tasks, achieving approximately 60% pass@1 versus 51%. The core finding suggests that for enterprise AI workloads, reliability and specialization can outweigh raw parameter scale, especially when utilizing high-quality, domain-specific data and simple binary rewards.
Key takeaways
-
Specialization Over Scale
For complex, domain-specific tasks (like financial analysis), specialized workflows do not require generalist, polymath models. A smaller, focused model can achieve parity with, or exceed, much larger models, leading to better deployment economics.
-
The Power of Simple Rewards
13:20
The most effective training setup was surprisingly simple: using a single binary reward signal (correct/incorrect) rather than complex, multi-component reward engineering. The bottleneck was identified as disciplined tool use, not reasoning depth.
-
Generalization of Tool Discipline
The tool-use discipline learned on simple, single-table question-answer pairs successfully generalized to harder, multi-table questions requiring sequential decision-making and planning, without needing explicit multi-table training.