Your Coding Agent Is 6 Months Out of Date — Jakub Hojsan, Exa
Jakub Hojsan of Exa details how they built specialized search capabilities for coding and code-review agents, addressing the critical issue of Large Language Model (LLM) knowledge cutoffs. Exa's solution provides context-rich, token-efficient highlights by distilling massive documents (e.g., 100,000 characters) down to only the necessary snippets (e.g., 500 characters) for the LLM. The talk emphasizes that simply adding a web search tool is insufficient; agents require explicit rules for when and how to search. Exa's platform offers transparency (full search trace), cost efficiency, and model-provider independence, allowing integration across various LLMs and tools via the Exa MCP.
Key takeaways
-
The Knowledge-Cutoff Gap in Code Review
LLMs suffer from a knowledge cutoff, meaning they cannot review changes (like PRs) made after their training date. This gap is critical in code review, where reviewing recent changes requires access to current repository information.
-
Context-Rich, Token-Efficient Highlights
0:02
Instead of returning entire web pages, Exa's search engine uses an interpretation step to distill large documents into small, highly relevant snippets (e.g., 500 characters) for the LLM, significantly improving context quality and efficiency.
-
Agents Need Explicit Search Rules
0:04
Bolting on a web search tool is not enough. Agents must be provided with explicit rules (e.g., 'When a diff bumps a dependency, look at the upstream source') to guide when and how to use the search tool.
-
Exa's Technical Advantages
0:04
Exa provides transparency by giving the full search trace (exact queries, sources, and highlights), offering cost-effective pricing compared to native web search APIs, and ensuring model-provider independence.