James Moss - Using skills to pay the bills: graduating from solo hacks to a team workflow - DevCon26
Summary
The talk addresses the challenge of 'skill sprawl'—the uncontrolled proliferation and management of AI coding agent skills within large organizations. While skills are powerful because they encode domain-specific logic into an agent's context, their current lack of standardized versioning, review, and centralized governance creates significant technical debt. The speaker advocates for treating skills as first-class software assets, requiring dedicated practices like decomposition, mandatory registries, automated reviews, and formal lifecycle management (CDLC) to ensure reliability and scalability.
Key takeaways
-
Manage Skill Sprawl with a Centralized Registry
17:33
Due to the low barrier to entry for creating skills, organizations face an 'insane amount' of them (2 million+ on GitHub alone). A centralized registry is crucial for visibility, preventing overlap, and ensuring all teams use approved versions. This also helps mitigate non-technical users needing access without requiring full developer seats.
-
Adopt the Context Development Life Cycle (CDLC)
27:50
Just as code requires a Software Development Lifecycle (SDLC), skills and context require their own CDLC. Practices like skill reviews, automated testing, and version control must be applied to maintain quality and prevent 'rot' (skills going out of sync with the codebase).
-
Decompose Skills for Modularity
20:40
Instead of creating monolithic skills, break complex functionality into smaller, interconnected plugins. This allows agents to activate specific components and makes the skill set easier to maintain and debug.
-
Enforce Governance via Registries
22:30
Using a registry provides a single source of truth, allowing organizations to enforce policies (e.g., 'approved skills only,' minimum release age) and integrate security scanning tools like Snyk.
Technical details
-
Skill Failure Modes
720s
Key issues include: **Overlap** (multiple teams building the same thing in isolation), **Drift** (teams using older versions of skills when newer ones are available, e.g., 'Grill Me' vs. 'Grill with Docs'), **Rot** (skills becoming outdated relative to the codebase), and **Overloading** (too many skills in one repository, potentially causing agents to truncate descriptions and fail activation).
-
The Agentic Equation
1200s
An agent's output is a function of the Model, the Harness, and the Context. Since changing the model or harness is difficult, optimizing the context (via skills and instructions) is identified as the most effective lever for improving agent performance.
-
Skill Versioning and Scope
1300s
Skills must be version-controlled alongside the code they affect. Using local, non-repo-based skills ('global state') leads to 'works on my machine' problems because the agent's behavior depends on who is running it, creating a lack of audit trail.
-
Dependency Management
1780s
The ideal solution for managing dependencies between skills (especially those not in the same package) involves mechanisms like 'peer dependencies' or, more futuristically, allowing the agent to infer necessary skills by reading them from the context.
Mentioned resources
- Tessel
- GitHub
- Snyk
- APM (Artifact Package Manager)
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.
