The Video Signal

Topic

Retrieval Augmented Generation (RAG)

All digests tagged Retrieval Augmented Generation (RAG)

· 1:05:19

From complex docs to decision ready context for agentic financial workflows

The webinar details how LlamaIndex enables the creation of sophisticated document agents for financial services by transforming complex, unstructured data (PDFs, images, etc.) into accurate, decision-ready context. The platform provides a comprehensive workflow—including parsing, extraction, and indexing—to automate historically manual processes in areas like Private Equity deal analysis, corporate lending, and mortgage servicing. Key features include advanced layout analysis for tables/charts, cross-document reconciliation, and robust human-in-the-loop validation.

Key takeaways

  1. Context is the foundation of agentic workflows 3:55

    Successful AI agents are highly dependent on accurate context. The platform's mission is to make previously untapped, unstructured data accessible by providing high accuracy and low cost in document processing.

  2. Three core financial use cases demonstrated 10:30

    The solution covers Private Equity (LBO modeling from deal room dumps), Corporate Lending (processing credit packets like ABL agreements and financials), and Mortgage Servicing (analyzing loan packages including deeds of trust, appraisals, and disclosures).

  3. Workflow relies on multi-stage processing 11:45

    The process moves from document arrival through intelligent classification/splitting $\rightarrow$ optimal parsing (LlamaParse) $\rightarrow$ targeted extraction (LlamaExtract) $\rightarrow$ cross-validation and grounding, culminating in a structured output for downstream modeling.

Watch on YouTube Full article

· 7:46

Why RAG Solutions Fail with Complex Documents & Vector Databases

Standard Retrieval Augmented Generation (RAG) solutions often fail when processing complex, ambiguous, or contradictory real-world documents (such as evolving laws or policies). The video outlines practical architectural improvements—including robust document management and clarification loops—to ensure that AI systems can accurately handle data ambiguity and avoid presenting single answers where multiple valid interpretations exist.

Key takeaways

  1. RAG Failure Point: Data Contradiction 2:33

    Because real-world document sets are compiled over time by multiple people, they frequently contain contradictions (e.g., a 2012 law contradicting a 1912 law). A standard RAG solution must be designed to handle the possibility of multiple correct answers rather than assuming singularity.

  2. Solution 1: Preventing Unforced Errors 3:55

    Implement strong document management processes to prevent 'unforced errors' in the vector database. This means ensuring that outdated or superseded policies are removed, preventing confusion when a newer policy replaces an older one.

  3. Solution 2: Implementing Clarification Loops 4:45

    A clarification loop is a mechanism built into the AI solution that prompts the user to rephrase or specify their question if it is too vague (e.g., asking 'Who won the championship in 2010?' without specifying the sport). This ensures the input question is specific enough for accurate retrieval.

Watch on YouTube Full article

· 49:59

Let's build an AI agent - Phil Nash - NDC Copenhagen 2026

This talk demystifies AI agents by building one from scratch, demonstrating how Large Language Models (LLMs), tools, and memory work together in a continuous loop to achieve goals. The core mechanism involves an agent runtime that orchestrates function calls—allowing the LLM to interact with external systems like file systems or calculators. Advanced concepts covered include the Model Context Protocol (MCP) for standardized tool interaction and 'Skills' for progressive disclosure of capabilities, enabling agents to perform complex tasks like self-refactoring.

Key takeaways

  1. Agent Architecture 17:03

    An agent fundamentally runs tools in a loop to achieve a goal. This process requires an LLM, external tools (functions), and an orchestration layer (the 'harness') that manages the interaction.

  2. The Agent Loop 28:10

    The core agent functionality is implemented in a loop: The model generates function calls $\rightarrow$ The harness executes those functions (awaiting results) $ ightarrow$ The results are fed back to the model for the next step, continuing until the goal is met.

  3. Standardization via MCP 36:00

    The Model Context Protocol (MCP) provides a standardized way for agents to interact with services. It separates concerns into Server components (tools, resources, prompts) and Client components.

  4. Progressive Disclosure with Skills 40:05

    Skills allow for progressive disclosure of capabilities. Instead of loading all tool declarations at once, the agent only loads a skill's header initially and can request more details (resources, scripts) as needed.

Watch on YouTube Full article

· 1:09:03

Building retrieval harness for enterprise agents

This technical walkthrough details the architecture of an enterprise agentic retrieval harness, moving beyond traditional Retrieval Augmented Generation (RAG) systems. The core argument is that effective data access requires giving agents a comprehensive set of tools—including local file system traversal (GP), semantic search, keyword search, and multimodal analysis—rather than relying on a single indexing method. Key focus areas include managing complex document parsing, ensuring multi-tenancy via custom metadata, and optimizing vector storage for scale and cost.

Key takeaways

  1. Harness over RAG 2:00

    The most capable approach is not to select a single retrieval method (e.g., pure semantic search or pure GP access) but to build an agentic harness that allows the agent to decide how to combine multiple tools for data exploration and verification.

  2. The Role of File Primitives 4:20

    For document-driven workflows, critical primitives include: (1) Retrieval (hybrid search), (2) Directory listing/hierarchy traversal, (3) Grep for exact text matching, (4) Chunk-by-chunk analysis, and (5) Multimodal processing via localized screenshots.

  3. Enterprise Scaling Challenges 6:45

    Scaling to multi-tenant or million-file situations requires specialized indexing pipelines that manage data freshness, security, and permissioning. Using custom metadata attached during the parsing process is crucial for filtering access at the vector storage layer.

Watch on YouTube Full article