Inside OpenAI DevDay: Superhuman Computer Use, Decisions API, and the AI Cloud — Ari & Nikunj
OpenAI announced significant advancements in AI agent capabilities, particularly in 'Computer Use,' aiming for superhuman performance in software operation. Key announcements include **Dots**, a personal assistant product giving agents access to private Linux virtual machines in the cloud, and **GPT-6.1**, a new model offering substantial cost and speed improvements. For developers, the **Agents API** provides a unified platform for building on Computer Use, while the new **Decisions API** offers ultra-fast, low-latency classification and structured output, inspired by the recent 'Jev' model. The overall trend is moving toward an 'AI cloud' with higher-level primitives for memory, compute, and state management.
Key takeaways
-
Computer Use is Superhumaning
16:40
Computer Use agents are dramatically improved, moving from human-level to potentially 'literally superhuman' performance in real-world software tasks. This is achieved by combining multiple modalities: screenshots, accessibility data, the DOM, Playwright, and generated JavaScript code, allowing agents to debug and recover from failures more effectively. (Transcript)
-
Dots and Personal Computing
5:50
The 'Dots' product gives agents access to their own dedicated Linux virtual computer in the cloud, enabling them to run full desktop applications and interact with complex, non-API-exposed software, expanding agent utility beyond simple web browsing. (Transcript)
-
New Developer APIs for Scale
10:00
New API features include **async tool calling**, **mid-turn steering**, and **WebSockets**, which enable bidirectional, real-time communication with the model. The **Agents API** centralizes Computer Use capabilities, allowing developers to build on a consistent, high-performance foundation. (Transcript)
-
Decisions API for Speed
11:40
The Decisions API is designed for extremely fast classification and structured output. It operates in parallel and is a smaller model than those used for complex Computer Use tasks, making it ideal for high-throughput, low-latency applications. (Transcript)