Why LLM Recommenders Will Be AI's Biggest Consumer App — Devansh Tandon, Meta
Devansh Tandon argues that recommendation systems (recsys) are following scaling laws similar to Large Language Models (LLMs), positioning the LLM recommender as one of the most significant and token-efficient consumer AI applications. The core technical advancements involve using Semantic IDs to compress content tokens and building a multi-stage LLM recommender (pre-training, post-training) that can reason over user history and content. This shift enables 'steerable' feeds, giving users control over their algorithmic experience.
Key takeaways
-
LLM Recommenders are a Major Consumer AI Application
The LLM recommender is predicted to be one of the biggest consumer applications of AI because content feeds are structurally more token-efficient than general AI chat apps, making them up to 100x cheaper to run for an hour of engagement.
-
Recommendation Systems Follow Scaling Laws
3:35
Recsys follow a power law of scaling similar to LLMs, where increasing model size, data, and compute leads to predictable improvements in recommendation quality and real-world engagement impact.
-
The LLM Recommender Recipe
13:25
Building an LLM recommender involves three steps: 1) Tokenizing content using Semantic IDs, 2) Adapting the LLM to be bilingual (English and domain language), and 3) Post-training the model to rank content using chain-of-thought reasoning.