Topic
All digests tagged LLM Cost Optimization
Sydney Runkle details how to build a model router in the harness to reduce operational costs. By analyzing task traces and selecting models along the Pareto frontier, the router cut median cost per thread by 64%.
Read article
Kimchi is an open-source coding harness that optimizes LLM usage by measuring cost per task, not cost per token. It features Ferment for autonomous, milestone-based coding and Teleport for remote, continuous agent sessions.
Read article
To optimize AI coding agent workflows and reduce token costs, use powerful models as advisors/planners and smaller models as executors. Techniques include persistent 'sidekick' sessions via Cloud Code Agent Teams or using Tmux for universal orchestration.
Read article