Training Taste — Thais Castello Branco, Taste Labs
Summary
Taste Labs addresses the problem of 'AI slop'—the homogenization and lack of context in AI-generated content—by proposing a shift in focus from model training to the application layer (inference time). The core methodology involves quantifying subjective domains like design by training 'probes' (small classifiers) on massive datasets (over 2 million websites). This approach allows for the measurement and prediction of slop, which is superior to traditional LLM-as-a-judge methods. Solutions include the 'Brand API' for structuring brand guidelines into machine-readable components and the 'Creativity API' for intentionally generating out-of-distribution content while respecting domain rules.
Key takeaways
-
Defining Slop and Greatness
4:13
Slop is defined by three characteristics: repetition, lack of fit (contextual incoherence), and low intent. While defining 'greatness' is subjective, defining slop is easier, as it represents a general sense of soullessness and convergence.
-
Measuring Slop Quantitatively
5:46
Taste Labs analyzed over 2 million websites from the past decade to understand design trends. They developed 'probes'—small classifiers—that extract objective features (e.g., contrast, alignment, palette) to predict slop, achieving higher accuracy than LLM-as-a-judge methods.
-
Focusing on Inference Time
5:46
The most critical intervention point is the application layer (inference time), where user context and intent are exchanged. Improving quality here is considered equally, if not more, important than improving the base model itself.
Technical details
-
Slop Detection Methodology
346s
The team trained 'probes' (small classifiers) on mined features (colors, typography, layout) from large datasets. By combining the frequency of multiple probes, they can quantitatively predict slop, which was shown to outperform LLM-as-a-judge methods.
-
Brand API
590s
This product takes a brand URL and extracts its aesthetic rules into structured components. This allows agents to follow brand guidelines while providing a crucial mechanism for human judgment and verification to ensure adherence and quality.
-
Creativity API
460s
A system designed to intentionally produce content that is 'out of distribution' rather than merely random. It aims to break rules creatively while maintaining adherence to the general expectations of a specific domain (e.g., a pitch deck).
-
Brand Repository
680s
A proposed index of pre-created, cohesive brand systems. This allows average consumers to select a 'dreamy' or 'professional' style rather than relying on a potentially poor generative approach.
Mentioned resources
- Taste Labs
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.