Topic

LLM Workflow Optimization

All digests tagged LLM Workflow Optimization

· 20:17

Paste This Into Claude, Never Hit a Token Limit Again

This guide details advanced strategies for minimizing token consumption when interacting with Large Language Models (LLMs) like Claude and Codex. The core problem is 'reused input,' where every subsequent message resends the entire conversation history, leading to massive waste (up to 96% of tokens). Solutions are tiered: Level 1 involves user habits (e.g., editing mistakes instead of re-asking); Level 2 introduces automated tools like the 'Token Saver skill'; and Level 3 utilizes advanced frameworks such as Ringer for local, pre-model request constraint.

Key takeaways

  1. Edit Mistakes Instead of Re-Asking 4:40

    When correcting an AI error or typo, use the edit function rather than starting a new chat thread and stating 'that was wrong.' This prevents unnecessary token accumulation. (04:40)

  2. Start Clean Tasks for Job Changes 15:35

    When switching to a new, specific task, start a fresh chat thread. Continuing long conversations is good for focus but highly token-intensive and increases the volume of 'reused input.' (15:35)

  3. Carry Forward Artifacts, Not Arguments 15:35

    In multi-step processes (e.g., research followed by writing), only pass the final artifact or result from Stage A to Stage B. Do not include all previous drafts, criticisms, or rejected sources. (15:35)

  4. Use Local Retrieval and Caching

    Whenever possible, perform searches locally rather than relying on the model to search files, as this is a massive token burner. Also, use external databases (like OpenBrain) for frequently needed data points to avoid recalculation. (18:51)

  5. Enforce Hard Token Limits

    For critical workflows, use an intermediary tool like Ringer to enforce hard limits on the input/output packet size, ensuring predictable resource usage. (18:51)

Watch on YouTube Full article

· 16:56

Tessl Skills Clinic - Nnenna Ndukwe from Qodo

The session demonstrates how automated AI agent skills can be rigorously tested and improved using Tessl's review process against Anthropic's best practices. By applying human-guided refinements—particularly enhancing the skill description with natural trigger phrases and optimizing structure—the Qodo PR Resolver skill score jumped from 78% to 89%. This highlights that while AI generation is powerful, manual validation and refinement are crucial for achieving high-quality, reliable agent performance in production workflows.

Key takeaways

  1. Skill Description is Critical for Agent Triggering

    The skill's description metadata is identified as the single biggest factor determining if an agent will use it. Improving this by adding natural trigger phrases (e.g., 'coding issues,' 'code reviews') significantly increases discoverability and usage likelihood.

  2. Human Refinement Boosts Skill Quality

    Research suggests that while AI-generated skills are useful, validated and refined skills (human intervention) show a significant performance uplift. The average jump observed was approximately 14% for human-written skills.

  3. The Importance of Post-Fix Verification

    It is a best practice to include a validation step (e.g., running linters and static analysis) after an agent has applied fixes, ensuring the code remains compliant even after automated changes.

Watch on YouTube Full article