Vector Isn't Enough: Hybrid Search & Retrieval — Jeff Vestal & James Williams, Elastic
This workshop details the architecture of advanced retrieval systems for AI agents, arguing that robust retrieval is paramount for accurate LLM outputs. It guides attendees through combining semantic (vector) search and traditional lexical (BM25) search into a 'hybrid search' approach. Key focus areas include optimizing the retrieval layer using techniques like reciprocal rank fusion (RF), linear combination, and advanced reranking, all within the Elasticsearch platform.
Key takeaways
-
Hybrid Search is the Core Thesis
20:44
The most effective retrieval systems combine the strengths of dense vector semantic search (good for paraphrasing/meaning) and lexical search (BM25, good for exact identifiers/keywords). Combining these methods is crucial for comprehensive search results.
-
The Importance of Source Citation
1:05:50
For trustworthy AI agents, the ability to cite sources is critical. The system must not only provide an answer but also show the underlying documents, mitigating the risk of LLM hallucination.
-
Reranking for Precision
1:10:00
Reranking is a second, optional phase that improves precision by combining the query and document during scoring. Listwise rerankers (like the Gina V3 model) are particularly useful when candidate documents are highly similar.
-
Agentic Search Architecture
1:06:40
Modern agentic search systems should be designed to allow the LLM to perform multiple steps (e.g., diagnose a problem, then suggest a fix) by utilizing tools and skills, which can be programmed via APIs.