LangChain

Interrupt NYC: Opening Keynote

Published 2026-10-05 · Duration 32:10

Summary

Harrison Chase outlines the shift in AI development from simple LLM prototypes to complex, domain-specific agent applications. The core concept is 'owning your intelligence' by building specialized components around foundational models. LangChain addresses this through its platform, LangSmith, which provides three pillars: an open, model-neutral harness (like LangGraph or Deep Agents); a compounding loop for continuous learning from user interactions; and robust governance for internal enterprise use. Key product announcements include Managed Deep Agents, the decision model Jev, and LangSmith Engine v2, which automates issue detection and red teaming.

Download summary

Key takeaways

  1. The Shift to Domain-Specific Agents

    AI applications are moving beyond simple LLM calls. Success requires building specialized harnesses and data layers around the model to provide differentiated, domain-specific value (e.g., Rogo for finance, Harvey for legal).

  2. Three Pillars of Owning Intelligence 15:20

    To own intelligence, organizations must focus on: 1) An open, model-neutral harness (e.g., LangGraph, Deep Agents); 2) Compounding intelligence from user usage (the feedback loop); and 3) Governance (managing auth, costs, and internal access).

  3. LangSmith Engine v2 Capabilities 30:00

    The platform's intelligence layer, LangSmith Engine v2, can now proactively test its fixes on deployments, perform red teaming simulations, and automate the creation of initial evaluation datasets, having scanned over 70 million traces and detected over 21,000 issues.

Technical details

  • Managed Deep Agents 1242s

    This platform combines the agent harness and managed infrastructure into one, simplifying deployment. New features include enhanced auth primitives (user-level vs. service-level identity), user-level memory, and built-in web search via Parallel.

  • Decision Models (Jev/SemIf) 1551s

    Decision models, such as Jev, are specialized tools that make decisions (scoring questions, choosing categories) rather than generating text. They are critical for model routing, guardrails, and evaluating agent performance. They are accessible via the LangSmith LLM Gateway.

  • LangSmith LLM Gateway 1800s

    This gateway normalizes LLM access (e.g., OpenAI and Anthropic message format) and is crucial for governance. It enables cost control, rate limiting, and implementing stateful fallbacks across multiple model providers.

  • Observability and Evals

    LangSmith Trajectories standardize the representation of multi-turn agent interactions, making debugging faster and providing a standard format for fine-tuning data. LangSmith Fine-Tuning uses the smithtune CLI to select, pre-process, and pass data to training infrastructure (e.g., Fireworks, Baseten).

  • Agent Runtime Components

    An agent requires three components: 1) Business Logic (instructions, tools); 2) The Harness (e.g., Deep Agents, LangGraph) to manage context; and 3) Infrastructure (durable execution, secure tool access, model access). LangSmith Deployment addresses the infrastructure layer.

Mentioned resources

  • LangSmith (Platform)
  • LangGraph (Open Source Framework)
  • Deep Agents (Open Source Library)
  • Jev (Decision Model)
  • LangSmith LLM Gateway (Service)
  • LangSmith Trajectories (Feature)
  • smithtune CLI (CLI Tool)
  • LangSmith Engine v2 (Service)
  • SmithDB (Database)

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.