Write Drunk, Edit Sober: Creating Generative Content Responsibly - Matthijs van der Veer
The talk addresses the proliferation of 'AI Slop'—low-quality, inauthentic content generated by LLMs—and provides a framework for developers to build automated systems that enforce quality. The core philosophy is shifting focus from merely generating content ('Write Drunk') to defining clear intent and implementing rigorous review processes ('Edit Sober'). Practical solutions involve using structured data inputs (like GitHub Issues) to capture user intent, applying Natural Language Processing (NLP) techniques like lemmatization for stylistic checks, and building automated quality gates that flag common LLM patterns (e.g., excessive emojis, M dashes, or generic corporate tropes).
Key takeaways
-
Identify 'AI Slop' Patterns
0:23
Common signs of low-quality AI content include overuse of emojis, the M dash (`—`), bold text, overly positive/generic language, and vague phrasing like 'In an era...' (0:023 - 0:045).
-
Focus on Intent over Content
2:38
The most critical step in generating quality AI content is defining the core intent: What do you want the audience to learn? Who should be here? And what can they accomplish? This structured approach guides the LLM (0:158 - 0:236).
-
Automated Quality Gates are Essential
7:55
Developers can build tools that enforce quality by implementing deterministic checks. Techniques include using NLP libraries like `spacy` for lemmatization to identify overused or non-standard vocabulary, and running pattern matching against known 'tropes' (0:475 - 1:239).
-
Mitigate Automation Bias with Metrics
23:10
To combat the tendency to overly trust machine output (automation bias), systems should provide explicit metrics, such as a confidence score or probability of error, rather than simply offering recommendations. Offering raw information is safer than recommending an action (1:390 - 2:150).