Topic

WebRTC

All digests tagged WebRTC

Generative Video at the Speed of Light — Keegan McCallum, uRun thumbnail

· 8:43

Generative Video at the Speed of Light — Keegan McCallum, uRun

The presentation shifts the focus of generative video from improving quality (e.g., Sora) to maximizing efficiency and enabling long-horizon, real-time interaction. The core argument is that the limiting factor is no longer model fidelity but the serving infrastructure required for continuous, synchronized streaming. Key technical requirements include global GPU distribution, WebRTC/ICE/TURN setup, and complex pipelines capable of integrating multiple models (e.g., video-to-video transformation) in real time.

Key takeaways

  1. Shift from Quality to Efficiency 3:55

    The most significant axis of improvement is efficiency and long horizon generation, allowing for continuous streaming at a fraction of the cost compared to slower, high-quality generations. For example, real-time generation can be produced at about 1/100th the cost of minutes-long clips.

  2. Cost and Accessibility 6:24

    Generative video is becoming highly accessible: $10 can now buy roughly three hours of continuous generated video, while $50 could provide up to 15 hours of interaction.

  3. New Interaction Paradigms 7:18

    The technology enables new use cases beyond simple content creation, such as 'magic mirrors' (transforming a webcam feed in real time) and providing visual mediums for users who do not think primarily in text.

Watch on YouTube Full article

Build a live translation broadcast app with the Gemini Live API and LiveKit thumbnail

· 1:34

Build a live translation broadcast app with the Gemini Live API and LiveKit

This technical demonstration outlines the architecture for a real-time, multilingual broadcast application using the Gemini 3.5 Live Translate API. The system leverages LiveKit and Google Cloud Run to manage long-running WebSocket connections, enabling scalable, real-time speech translation and caption broadcasting via WebRTC data channels.

Key takeaways

  1. Real-Time Multilingual Broadcast

    The application uses Gemini 3.5 Live Translate to set up and manage live translation sessions for multiple languages, subscribing listeners to existing sessions rather than creating new ones for every request.

  2. Scalable WebSockets with Cloud Run

    Deploying Next.js to Google Cloud Run allows the application to maintain long-running WebSocket connections, which is critical for real-time communication.

  3. WebRTC for Captioning

    WebRTC data channels are utilized to broadcast captions alongside the audio stream, enhancing the real-time user experience.

Watch on YouTube Full article