# Robots That Predict the Future: Dyna-2 & Physical AI — Jason Ma, Dyna Robotics

## Executive summary

Dyna Robotics is advancing physical AI by moving beyond simple demos to reliable, general-purpose industrial deployments. The core technology is the Dyna-2 world action model, which is trained on over one million hours of human video data. This model predicts the future state of the physical world and uses that prediction to guide robot actions, allowing for high levels of dexterity and generalization. The company emphasizes that true value lies not in single-task pilots, but in deploying robots across multiple customer sites to handle complex, long-horizon workflows (e.g., full laundry cycles or restaurant service).

## Key takeaways

- World Action Models (Dyna-2): Dyna-2 is a world action model trained on over 1 million hours of data. It predicts the future video/state of the world and uses this prediction to guide robot actions, making the robot more robust and capable of generalizing to unseen scenarios. The model architecture is based on a Diffusion Transformer, which refines the output to achieve smooth, precise, fine-grain motion required for physical execution.
- Generalization and Data Efficiency: The system is designed to be generalist. After initial training on massive human data, the model can adapt to new tasks with minimal fine-tuning, sometimes requiring as little as 45 minutes of demonstrations (e.g., pulling drinks from a fridge). This approach is key to achieving production-level consistency across different sites.
- Workflow Automation (Agentic Harnesses): The value of the system is in solving long-horizon tasks or workflows, not single actions. An 'agentic harness' layer is used to wrap the world action model, enabling high-level decision-making (e.g., 'if the washer is running, I should go do X while waiting') and composing multiple skills into a single, continuous process, such as an entire laundry cycle.
- Industry Bottlenecks: The primary bottlenecks to achieving truly general-purpose robotics are hardware limitations (e.g., durable, dextrous hands that don't overheat) and data acquisition. While egocentric human video data is crucial, the model currently lacks critical sensory inputs like touch, smell, and sound, limiting full world prediction.

## Technical details

- World Action Model Architecture: The model uses a Diffusion Transformer architecture, which is effective for generating high-dimensional, precise actions. Flow Matching is utilized as an efficiency improvement over traditional diffusion steps, simplifying the training schedule while maintaining performance.
- Input/Output Streams: Inputs include video/images captured by the robot's cameras, joint encoder data (angles of the robot's joints), and language instructions. The output includes executable actions for the hardware, alongside a future video representation of the world state.
- System Stack: The system requires a full-stack approach, including custom hardware (semihumanoid form factor with wheels for stability), a dedicated inference stack to manage low latency, and the model itself. The hardware design is often tied to the model's ability to be accurately simulated.

## Practical implications

- The focus on general-purpose platforms rather than specialized robots allows for faster deployment and adaptation across diverse industrial settings (e.g., folding napkins at Din Tai Fung, then cutting food).
- The ability to automate entire end-to-end workflows (e.g., laundry cycles) represents a significant leap from simple task execution, enabling robots to function as 'employees' in a workplace.
- The necessity of owning the entire stack—from actuators and hardware to the model and inference engine—is critical for achieving reliable, production-grade performance.

## Topics

Physical AI, World Models, Diffusion Transformers, Robotics, Agentic Systems, General Purpose Robotics, Dyna-2 Blog

Source: https://www.youtube.com/watch?v=BHiYomkfoGQ