OpenRouter State Of Models: Jev, Open-Weights, and Tokenomics
The AI landscape is characterized by massive, near-exponential growth in token usage (e.g., 146 trillion tokens last week), indicating strong demand but necessitating a focus on 'tokconomics'—maximizing value per token spent. The market is highly competitive, with open-weights models and specialized classifiers (like Jev) challenging traditional LLM providers. Engineers are advised to move beyond simply using more tokens and instead focus on building complex, multi-model agentic workflows that optimize for performance, speed, and cost.
Key takeaways
-
Token Usage is Skyrocketing
3:20
OpenRouter recorded 146 trillion tokens used last week, compared to 4.5 trillion the previous year. This sustained growth suggests strong market demand, arguing against an 'AI bubble' narrative. (03:20)
-
Tokconomics is Key to Value
4:10
Simply increasing token usage does not equal increased value. Engineers must optimize their workflows to ensure token spend leads to genuinely useful work, rather than just burning tokens for perceived productivity. (04:10)
-
Specialized Models are Disrupting LLMs
8:30
Zero-shot classifier models, such as Jev, are emerging as a 'new species' of model. They are highly scalable, reliable, and can significantly reduce cost and improve speed when integrated into agents, complementing traditional LLMs. (08:30)
-
The Market is Decentralized
7:30
The AI race is not won by a single provider. The optimal scenario involves combining compute from multiple sources (e.g., DeepSeek, Gemini, Luna, and Jev) to achieve the best performance/cost trade-off. (07:30)