AI Engineer

2026 State of AI Engineering — Barr Yaron, Amplify Partners

Published 2026-07-21 · Duration 19:47

Summary

The state of AI engineering is characterized by rapid maturity and increased complexity. Survey data from 1,048 respondents indicates that while open-weight models augment closed systems, the primary drivers for model choice are quality, agentic capabilities (like tool calling), and cost. Cost has become a 'first-class engineering constraint,' forcing teams to manage usage carefully. Furthermore, agents are rapidly evolving from summarization tools to systems with write access, necessitating robust control layers and sophisticated evaluation (eval) processes.

Download summary

Key takeaways

  1. AI Experience is Democratizing 0:03

    The AI engineering workforce is maturing quickly; the median new engineer has nearly as much AI experience as a 10-year software veteran, indicating that AI skills are becoming foundational to modern development.

  2. Cost is a Primary Constraint 0:08

    Three out of four respondents report adjusting their AI usage based on cost, establishing 'cost' as a first-class engineering constraint alongside quality and capability.

  3. Agents are Taking Action 0:11

    Agentic workflows have shifted significantly: they are no longer limited to reading or summarizing, but are increasingly taking actions inside systems. Write access for agents has increased dramatically (from 52% to 89%).

  4. Evaluation Remains the Biggest Challenge 0:12

    Across all layers of the stack, 'eval' (evaluation) remains the number one biggest challenge reported by engineers.

Technical details

  • Model Strategy 3s

    Teams are not choosing between open-weight and closed models; rather, they are mixing and matching. Open-weight models primarily serve as an augmentation to existing closed model usage.

  • Model Selection Criteria 3s

    When selecting a model, the top considerations are quality, agentic capabilities (tool calling), and cost, with reliability being less frequently cited as a primary driver.

  • Build vs. Buy Stack Decisions 13s

    Inference and model serving is the layer most often 'bought' (off-the-shelf), while prompt management, RAG, and eval tend to be built in-house due to specialized product logic.

  • Modalities Adoption 5s

    While audio shows the highest 'intent to adopt' (56%), image generation saw a significant jump, with the share of respondents using generative AI for images doubling from 18% to 36%.

Mentioned resources

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.