Channel
Digests from AssemblyAI — AssemblyAI videos on speech AI, applied AI, and developer workflows.
Learn how to build a voice agent by integrating Speech-to-Text, LLMs, and Text-to-Speech. We demonstrate using AssemblyAI and LiveKit, including advanced features like tool calling and voice cloning.
Read article
Choosing the right STT model (Async, Sync, Realtime) depends on latency, cost, and whether a user is waiting for text. Learn the framework for building voice agents with Universal 3.6 Pro and avoid common API pitfalls.
Read article
Building smarter voice agents requires managing complex challenges like subsecond latency, multi-party turn-taking, and user trust. The discussion contrasts structured healthcare flows with open networking interactions.
Read article
Learn how to build low-latency dictation features using the Sync API, connection warming, and LLM cleanup passes. The process is optimized to deliver results in under one second.
Read article
Building production voice agents requires a modular, cascading architecture (ASR $\rightarrow$ LLM $\rightarrow$ TTS). Key focus areas include managing latency within a 1-1.5 second budget and implementing robust fallback systems across all components.
Read article
Learn how to boost voice agent transcription accuracy with Agent Context Carryover. This feature automatically feeds conversational context into LiveKit's Universal 3.5 Pro model, simplifying complex AI integrations.
Read article
Universal 3.5 Pro enhances STT with contextual awareness, allowing developers to pass domain-specific prompts and maintain conversation context for highly accurate transcription in voice agents.
Read article