OpenRouter State Of Models: Jev, Open-Weights, and Tokenomics
Summary
The AI landscape is characterized by massive, near-exponential growth in token usage (e.g., 146 trillion tokens last week), indicating strong demand but necessitating a focus on 'tokconomics'—maximizing value per token spent. The market is highly competitive, with open-weights models and specialized classifiers (like Jev) challenging traditional LLM providers. Engineers are advised to move beyond simply using more tokens and instead focus on building complex, multi-model agentic workflows that optimize for performance, speed, and cost.
Key takeaways
-
Token Usage is Skyrocketing
3:20
OpenRouter recorded 146 trillion tokens used last week, compared to 4.5 trillion the previous year. This sustained growth suggests strong market demand, arguing against an 'AI bubble' narrative. (03:20)
-
Tokconomics is Key to Value
4:10
Simply increasing token usage does not equal increased value. Engineers must optimize their workflows to ensure token spend leads to genuinely useful work, rather than just burning tokens for perceived productivity. (04:10)
-
Specialized Models are Disrupting LLMs
8:30
Zero-shot classifier models, such as Jev, are emerging as a 'new species' of model. They are highly scalable, reliable, and can significantly reduce cost and improve speed when integrated into agents, complementing traditional LLMs. (08:30)
-
The Market is Decentralized
7:30
The AI race is not won by a single provider. The optimal scenario involves combining compute from multiple sources (e.g., DeepSeek, Gemini, Luna, and Jev) to achieve the best performance/cost trade-off. (07:30)
Technical details
-
OpenRouter Market Data
360s
OpenRouter tracks model usage, showing DeepSeek, Google, and OpenAI consistently in the top three market share spots. The platform is used as a proxy for individual engineer and small-to-medium business spending, contrasting with large enterprise spending. (06:00)
-
Model Performance & Trade-offs
390s
Gemini 3.8 Flash is highlighted for its effective balance of performance, speed, and cost, making it a strong workhorse model. (06:30)
-
Jev Classifier Model
510s
Jev is a zero-shot classifier model that offers superior scalability and reliability compared to many alternatives. Integrating Jev into agentic workflows can save significant token spend (estimated 20%) and improve speed. (08:30)
-
Agentic Engineering
660s
The trend favors owning and customizing agentic coding tools (e.g., PI coding agent) over renting them, providing a significant competitive advantage in workflow control and cost management. (11:00)
Mentioned resources
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.