Topic

LangSmith Engine v2

All digests tagged LangSmith Engine v2

Interrupt NYC: Opening Keynote thumbnail

· 32:10

Interrupt NYC: Opening Keynote

Harrison Chase outlines the shift in AI development from simple LLM prototypes to complex, domain-specific agent applications. The core concept is 'owning your intelligence' by building specialized components around foundational models. LangChain addresses this through its platform, LangSmith, which provides three pillars: an open, model-neutral harness (like LangGraph or Deep Agents); a compounding loop for continuous learning from user interactions; and robust governance for internal enterprise use. Key product announcements include Managed Deep Agents, the decision model Jev, and LangSmith Engine v2, which automates issue detection and red teaming.

Key takeaways

  1. The Shift to Domain-Specific Agents

    AI applications are moving beyond simple LLM calls. Success requires building specialized harnesses and data layers around the model to provide differentiated, domain-specific value (e.g., Rogo for finance, Harvey for legal).

  2. Three Pillars of Owning Intelligence 15:20

    To own intelligence, organizations must focus on: 1) An open, model-neutral harness (e.g., LangGraph, Deep Agents); 2) Compounding intelligence from user usage (the feedback loop); and 3) Governance (managing auth, costs, and internal access).

  3. LangSmith Engine v2 Capabilities 30:00

    The platform's intelligence layer, LangSmith Engine v2, can now proactively test its fixes on deployments, perform red teaming simulations, and automate the creation of initial evaluation datasets, having scanned over 70 million traces and detected over 21,000 issues.

Watch on YouTube Full article