AI Engineer Paris 2026 Main Stage: Google DeepMind, ElevenLabs, Hugging Face & Stripe | Day 2
This summary covers advanced topics in production AI systems, focusing on scaling generative media, optimizing LLM inference, and building real-time AI features. Key technical deep dives include customizing generative models (e.g., Flux for action prediction), achieving low-latency speaker diarization, and optimizing model deployment by integrating Hugging Face's `transformers` library into `vLLM`. Furthermore, the talks emphasize that modern AI development requires a global, agent-centric playbook, necessitating localized payments and robust fraud monitoring.
Key takeaways
-
AI Model Customization is Multi-Layered
23:20
Customizing models like Flux involves optimizing multiple surfaces: Prompt Upsampling (using VLM/LLM to steer user intent), Moderation (via configurable APIs or embedding into weights using LoRA), and adding new modalities (e.g., Flux Action for robot control).
-
Optimizing LLM Inference with vLLM
41:40
The `transformers` modeling backend allows running Hugging Face models directly in `vLLM`, enabling access to advanced features like KV cache, continuous batching, and expert parallelization while maintaining the original model's code base.
-
Real-Time AI Requires Causal Segmentation
46:40
Achieving low-latency speaker diarization for voice agents requires moving from batch processing to causal segmentation, which processes audio in streaming chunks to maintain accuracy while minimizing latency (e.g., achieving 400ms latency).
-
AI Product Playbook Must Be Global and Agent-Ready
50:00
Successful AI companies must treat their day-one market as the entire world, localizing pricing, payment methods, and adapting their product design to be discoverable and purchasable by AI agents.