Notion's Token Town — Sarah Sachs, Notion
The presentation argues that building sustainable AI-native products requires shifting focus from optimizing token economics to mastering product architecture and optionality. The speaker warns against vendor lock-in due to volatile model pricing (the 'token town' trap) and advocates for strategies like implementing an 'auto model,' leveraging open weight models, prioritizing CPUs over GPUs for deterministic tasks, and building robust multi-agent orchestration systems.
Key takeaways
-
Vendor Lock-In is the Primary Risk
12:08
Relying solely on a single AI provider creates significant risk because pricing structures are volatile. The speaker asserts that 'your supplier is your competitor' (7:28), making model agnosticism crucial for business viability.
-
Win on Product, Not Tokens
14:04
Instead of competing on the lowest cost per token, companies must build data flywheels and orchestration layers that solve unique customer problems. The value should come from the product's workflow, not just its underlying model capability (8:44).
-
Implement Model Agnosticism
22:05
To maintain optionality, systems must be designed to route traffic across multiple models and providers (e.g., Notion’s 'auto model' handling 75% of traffic) to mitigate pricing shocks or provider deprecations (13:25).
-
Prioritize CPUs for Deterministic Tasks
For tasks that do not require complex reasoning—such as turning a CSV into a PDF, running deterministic SQL queries, or simple tool calls—CPUs are often more cost-effective and efficient than relying on GPUs/LLMs (17:00).