Build a live translation broadcast app with the Gemini Live API and LiveKit
This technical demonstration outlines the architecture for a real-time, multilingual broadcast application using the Gemini 3.5 Live Translate API. The system leverages LiveKit and Google Cloud Run to manage long-running WebSocket connections, enabling scalable, real-time speech translation and caption broadcasting via WebRTC data channels.
Key takeaways
-
Real-Time Multilingual Broadcast
The application uses Gemini 3.5 Live Translate to set up and manage live translation sessions for multiple languages, subscribing listeners to existing sessions rather than creating new ones for every request.
-
Scalable WebSockets with Cloud Run
Deploying Next.js to Google Cloud Run allows the application to maintain long-running WebSocket connections, which is critical for real-time communication.
-
WebRTC for Captioning
WebRTC data channels are utilized to broadcast captions alongside the audio stream, enhancing the real-time user experience.