Is Opus 5.5 Better At Writing?
This evaluation compares the writing capabilities of Opus 5 and Opus 5.5 across six diverse tasks (FAQ generation, summarizing technical posts, drafting replies, and writing abstracts). While Anthropic claims Opus 5.5 writes more naturally and follows instructions better, the evaluation concludes that both models still produce 'slop'—content that requires significant human editing. Opus 5.5 generally performed better, particularly in structure and flow, but the overall finding is that AI-generated content, especially in complex technical writing, is far from ready for deployment without heavy refinement.
Key takeaways
-
Opus 5.5 shows structural improvements over Opus 5.
In multiple blind comparisons, Opus 5.5 was observed to be better, particularly in organizing information and maintaining a more natural flow. However, the difference was not always definitive, and both models struggled with complex, nuanced writing tasks.
-
Models frequently over-correct or hallucinate details.
5:37
When summarizing technical posts, models tended to over-steer based on the prompt, adding unnecessary context or fabricating details (e.g., inventing the 'spam' example for a classifier). This highlights a risk of factual inaccuracy in AI output.
-
The challenge of 'Slop' persists.
Despite improvements, the consensus is that 'slop' (low-quality, generic, or overly structured content) is not solved. The models often write the same thing in the same order, making the output difficult to trust without rigorous human review.
-
The best performance was seen in structured, constrained tasks.
0:55
The models performed best when given highly specific context or when the task was limited (e.g., writing a short FAQ). However, even in these cases, the output required substantial editing.