Voice Agent observability with LangSmith 🌟
This session demonstrates how to achieve deep observability for voice agents using LangSmith when integrating Google's Gemini Live model and the Google ADK. Since Gemini Live is a native speech-to-speech model that bypasses text transcription to maintain low latency, robust tracing is critical. The process involves setting up tools (like a weather assistant), recording both user and agent audio, and utilizing LangSmith to view comprehensive traces that include transcripts, tool calls, interruption events, full cost breakdowns, and even audio playback for debugging.
Key takeaways
-
Gemini Live's Low-Latency Advantage
Gemini Live is Google's native speech-to-speech model; it takes audio directly as input and produces audio output without transcribing to text, which keeps latency low and ensures a natural voice experience.
-
Comprehensive Voice Agent Tracing
LangSmith provides visibility into the agent's internal workings, capturing not only standard transcripts and tool calls but also specific events like interruptions and detailed token-level cost breakdowns.
-
Production Readiness Tools
The observability provided by LangSmith allows engineers to perform standard LLM operations—such as running evals, adding traces to data sets, building dashboards, and debugging—on complex voice agent interactions.