# AI Engineer Paris 2026 Main Stage: Google DeepMind, ElevenLabs, Hugging Face & Stripe | Day 2

## Executive summary

This summary covers advanced topics in production AI systems, focusing on scaling generative media, optimizing LLM inference, and building real-time AI features. Key technical deep dives include customizing generative models (e.g., Flux for action prediction), achieving low-latency speaker diarization, and optimizing model deployment by integrating Hugging Face's `transformers` library into `vLLM`. Furthermore, the talks emphasize that modern AI development requires a global, agent-centric playbook, necessitating localized payments and robust fraud monitoring.

## Key takeaways

- AI Model Customization is Multi-Layered: Customizing models like Flux involves optimizing multiple surfaces: Prompt Upsampling (using VLM/LLM to steer user intent), Moderation (via configurable APIs or embedding into weights using LoRA), and adding new modalities (e.g., Flux Action for robot control).
- Optimizing LLM Inference with vLLM: The `transformers` modeling backend allows running Hugging Face models directly in `vLLM`, enabling access to advanced features like KV cache, continuous batching, and expert parallelization while maintaining the original model's code base.
- Real-Time AI Requires Causal Segmentation: Achieving low-latency speaker diarization for voice agents requires moving from batch processing to causal segmentation, which processes audio in streaming chunks to maintain accuracy while minimizing latency (e.g., achieving 400ms latency).
- AI Product Playbook Must Be Global and Agent-Ready: Successful AI companies must treat their day-one market as the entire world, localizing pricing, payment methods, and adapting their product design to be discoverable and purchasable by AI agents.

## Technical details

- Generative Media & Action Prediction: Black Forest Labs demonstrated customizing the Flux model for action prediction (Flux Action). This involves mid-training and post-training fine-tuning to predict robot movements (e.g., a 6-dimensional vector for a robot arm) by treating the model as a World Action Model, which normalizes action vectors directly into the latent space.
- LLM Inference Optimization (vLLM): The `transformers` modeling backend integrates Hugging Face models into `vLLM`'s runtime. This is achieved by patching the model's configuration, registering attention shims (e.g., `VLM attention`), and surgically replacing layers (e.g., QKV fuser, RMS norm) to gain access to `vLLM`'s performance features like KV cache and continuous batching.
- Voice AI & Diarization: Speaker diarization involves segmenting conversations and assigning turns to speakers. For real-time applications, the process must shift from batch processing (sliding windows) to causal segmentation, which processes audio in streaming chunks to maintain accuracy and achieve low latency.
- AI Payments and Developer Experience: Stripe demonstrated how AI agents can streamline the setup of complex financial integrations. Developers can use prompts to configure payments (e.g., invoicing, subscriptions) and receive recommendations for specific integrations (like Stripe Checkout) and tax knowledge (Stripe Tax) without leaving their development environment.

## Practical implications

- Adopt a modular approach to AI features, treating components like prompt upsampling, moderation, and post-processing as distinct, customizable services.
- When deploying LLMs, prioritize inference engines like vLLM that support advanced techniques (e.g., continuous batching, expert parallelization) to maximize throughput and minimize latency.
- Design AI products with global readiness in mind, implementing localized pricing and payment methods to capture revenue from day one in diverse markets.
- For real-time voice applications, architect the system using causal segmentation techniques to balance low latency with high diarization accuracy.

## Topics

Generative Media, LLM Inference Optimization, Real-Time AI, Speaker Diarization, AI Economy, Prompt Engineering, Model Customization, Flux, Flux Action, vLLM, Hugging Face Transformers, Stripe Tax, pyannoteAI / PianoAI

Source: https://www.youtube.com/watch?v=g0vqT_wZtXA