Topic

AI Development

All digests tagged AI Development

Guide, Verify, Solve — Anirban Chatterjee, Sonar thumbnail

· 22:31

Guide, Verify, Solve — Anirban Chatterjee, Sonar

As AI-driven development moves from experimentation to engineering, the primary challenge is 'verification debt'—the gap between the quality provided by LLMs and the high reliability required for critical production systems. The speaker argues that relying solely on human review (which can be compromised, as shown by a Wharton study) or the generating model itself is insufficient. A robust solution requires implementing a zero-trust, multi-layered verification regime within agentic development loops to ensure code quality across syntax, data flow, architecture, and control flow.

Key takeaways

  1. Implement Zero Trust Verification 15:32

    Assume all code (human or AI) could come from anywhere. Verification must use a different methodology than the one that wrote the code to prevent inheriting blind spots.

  2. Adopt Multi-Layered Review 15:57

    No single technique is sufficient; verification must combine computational review, LLM-driven reasoning, and other approaches to catch all types of issues (quality, security, compliance).

  3. Use ACDC for Agentic Loops 17:12

    The proposed framework is the Agent-Centric Development Cycle (ACDC), which includes three phases: Guidance (providing constraints/guardrails), Verification (running independent checks in real time), and Solve (allowing the agent to remediate issues).

  4. Standardize Verification Across Projects 20:46

    Organizations should establish a single, consistent verification platform that applies uniformly across all teams, projects, and AI coding tools to eliminate blind spots.

Watch on YouTube Full article

3 things to know about the new CopilotKit integration for Angular thumbnail

· 1:26

3 things to know about the new CopilotKit integration for Angular

The new Copilot Genkit integration for Angular significantly upgrades the capability of building in-app AI features. The update allows developers to build agent-powered web applications and deeply integrated, context-aware AI functionalities directly into existing Angular architectures.

Key takeaways

  1. Copilot Genkit Integration for Angular

    Copilot Genkit has officially landed for Angular, enabling the creation of agent-powered web applications. Service AI maintains the Angular wrapper, ensuring production-ready reliability and full support.

  2. Context-Aware AI Features

    Developers can build deeply integrated features, including native SmartText areas, custom AI chatbots, and autonomous agents that seamlessly integrate with the Angular application state.

  3. Generative UI for Bespoke Interfaces

    The Generative UI feature allows an agent to utilize any component catalog within a design system, selecting and presenting the optimal user interface (UI) or requesting necessary inputs dynamically.

Watch on YouTube Full article

We Scored a Real Snyk Skill Against Anthropic's Rules thumbnail

· 15:19

We Scored a Real Snyk Skill Against Anthropic's Rules

This video details a live review process where a Snyk skill (`SKILL.md`) was evaluated using Tessl's `tessl review run` against Anthropic's best practices. The initial score of 87% was successfully improved to 90% by applying fixes, demonstrating how automated tools can enhance skill quality and security. Key focus areas include implementing progressive disclosure to prevent context bloat, improving skill conciseness, and using Snyk's Agent Scan tool to detect vulnerabilities like prompt injection in both first-party and third-party skills.

Key takeaways

  1. Skill Quality Improvement via Automated Review

    The review process successfully increased the skill score from 87% to 90% by applying fixes, demonstrating that automated tools can significantly improve adherence to best practices (e.g., Anthropic's guidelines).

  2. Importance of Progressive Disclosure 10:08

    Skills should not be overly dense or verbose. Implementing progressive disclosure—breaking large skills into smaller, referenced sub-files—prevents context bloat and ensures the agent only loads necessary information.

  3. Security Scanning with Agent Scan

    Snyk's dedicated tool, Agent Scan (available on GitHub), can scan skills for security vulnerabilities, including prompt injection, which is crucial when integrating third-party or user-written skills.

Watch on YouTube Full article

Agents Write 95% of Our Code. Here's the Catch thumbnail

· 29:43

Agents Write 95% of Our Code. Here's the Catch

As AI agents assume control over an estimated 95% of code production in advanced software factories, traditional code review processes are insufficient. The talk introduces the role of the 'harness engineer,' a new skill set focused on system-level controls: defining invariants, performing deep analytics on agent logs and PR data, and implementing fine-grained risk/operations policies (like auto-merge ladders). This shift requires engineers to move from writing code features to building robust guardrails that ensure consistency and quality across agent-driven pipelines.

Key takeaways

  1. The Paradox of AI Adoption 25:24

    While AI coding tool adoption is high, benchmarks are becoming saturated. Concurrently, the number of reported bugs and incidents is rising, indicating that agents may generate code that lacks maintainability or systemic health (00:15:24).

  2. The Rise of the Harness Engineer 9:34

    Engineering focus must shift from pure feature building to defining and enforcing system invariants. The three critical new skill sets are Systems Thinking, Analytics, and Risk/Operations (00:09:34).

  3. Instruction Following Gap in Skills 8:23

    Tessl's internal skills benchmark revealed that while agents achieved high task completion rates, they only followed approximately 70% of the total instructions defined within a skill (00:08:22).

  4. Systemic Control through Invariants and CI Gates 12:56

    Engineers must identify general principles (invariants)—such as design system rules or desired code structure—and encode them into deterministic checks, verifiers, or CI gates to ensure consistency across the codebase (00:12:56).

Watch on YouTube Full article

Antigravity Arcade: From prompt to game in minutes thumbnail

· 8:53

Antigravity Arcade: From prompt to game in minutes

The video details 'Antigravity Arcade,' a system that leverages AI skills and workflows to allow users to generate functional web games from simple ideas without writing code. The solution covers both the front-end game generation process—which enforces visual consistency using specialized AI skills (e.g., ensuring retro aesthetics, handling physical input)—and a robust back-end deployment pipeline for hosting these user-generated games on physical arcade cabinets.

Key takeaways

  1. AI-Powered Game Generation 3:30

    Antigravity uses modular 'skills' to guide the AI agent, preventing context window bloat and ensuring adherence to organizational best practices (e.g., consistent retro aesthetic, specific key mappings) when generating game code.

  2. Consistent Development Workflow 4:13

    The project enforced consistency by using a starting template built with Phaser JS's game engine, which included skills for visual guidelines (black background, CRT shader) and input handling to ensure cross-platform compatibility.

  3. Secure Deployment Pipeline 6:45

    A custom deployer CLI tool handles the deployment of user code to physical arcade cabinets. This process uses a Unix setuid model API to securely read sensitive API tokens without exposing them to the end-user or agent, followed by Cloud Run validation and GCS storage.

  4. Automated Game Moderation 8:02

    Upon successful upload, an Eventarc trigger spins up a Cloud Run function that validates the game. If approved, Firestore increments a counter, issuing a sequential ID for moderation via a web app.

Watch on YouTube Full article

Justin Cormack - When Tests Lie: Using Observability to Keep AI Honest - AI Native DevCon June 2026 thumbnail

· 32:04

Justin Cormack - When Tests Lie: Using Observability to Keep AI Honest - AI Native DevCon June 2026

The talk explores the challenges of using AI to build large-scale, complex distributed systems, exemplified by building an AWS S3 compatible object storage system in Rust. While testing is crucial, relying solely on achieving 100% test coverage is insufficient for complex systems. The speaker emphasizes that observability, robust test articles (like external services), and a 'human-in-the-loop' approach are necessary to enforce correctness, discover edge cases, and manage issues like race conditions and flaky tests in AI-assisted development.

Key takeaways

  1. Observability is Critical for Large Systems 17:47

    For complex distributed systems, the public API often doesn't cover all background behaviors. Observability techniques (like tracing) are necessary to infer or observe invisible behaviors that standard APIs cannot expose.

  2. Test Articles Provide Grounding 21:00

    Using an existing system, such as AWS S3, as a 'test article' provides a crucial behavioral baseline. This is more valuable than relying on documentation, which may be inaccurate.

  3. Beyond 100% Test Coverage 13:44

    Achieving 100% test coverage can lead to writing trivial or unhelpful tests. The focus should instead be on expanding the scope of testing and thinking like a QA professional to find edge cases.

  4. Flaky Tests Must Be Fixed 22:00

    The speaker asserts that flaky tests must be fixed immediately, as AI models may incorrectly suggest ignoring them based on training data. Running repeated test suites helps identify these issues.

Watch on YouTube Full article