Stop Rationing Tokens: Let the Harness Pick the Model — Kimchi by Cast AI
Cast AI introduced Kimchi, an open-source coding harness designed to address the unsustainable cost of LLM tokens. Instead of limiting developers by cost per token, Kimchi shifts the focus to 'cost per task,' automatically selecting the optimal proprietary or open model for each step based on the required outcome. The platform provides a full software development lifecycle solution, including Ferment for multi-hour autonomous coding runs, Teleport for remote sandboxes, and Studio for team-based agentic collaboration.
Key takeaways
-
Cost Metric Shift: Task vs. Token
5:05
The core principle is that comparing LLM models based solely on cost per token is misleading. Kimchi measures the true cost per task, allowing for automated model selection to maximize efficiency and minimize cloud expenditure.
-
Autonomous Model Selection
7:10
The Kimchi harness acts as an automated engine, selecting the best model (proprietary or open) for a given task at the right time, optimizing cost based on the desired outcome.
-
Autonomous Development Workflow (Ferment)
13:35
Ferment enables milestone-based, self-scoring autonomous coding runs that can deploy to staging. It constantly checks code quality, ensuring the output meets a minimum score (e.g., B or A) before proceeding.
-
Remote and Continuous Workflows (Teleport)
Kimchi Teleport spins up a secure sandbox in a remote environment (e.g., Google Cloud or on-premise Kubernetes cluster), allowing agent sessions to continue running even if the user closes their laptop or is in transit.