Topic

Fable

All digests tagged Fable

How Anthropic Builds: Lessons from Labs — Mike Krieger, Anthropic thumbnail

· 26:11

How Anthropic Builds: Lessons from Labs — Mike Krieger, Anthropic

Mike Krieger discusses the evolution of building with AI models, emphasizing that ambition requires being 'unreasonable' in tool usage and process design. He details advanced development workflows—such as porting large codebases (e.g., Python to TypeScript) over a weekend using LLMs—and outlines modern organizational structures for research labs (like Anthropic's), which prioritize rapid iteration through 'persevere or pivot' cycles rather than rigid project management. Key technical shifts include moving from task delegation to expressing end-state goals, and utilizing advanced features like tagging for multi-agent, proactive code development.

Key takeaways

  1. Be Unreasonable in AI Usage 4:15

    The first generation of AI products often constrained access to tools and degrees of freedom. To maximize potential, users must be 'unreasonable' in their prompts, moving beyond simple task delegation to defining the desired end state.

  2. The Importance of Intent Over Code Lines 17:17

    In large codebases (e.g., 2,000 line PRs), the bottleneck is no longer review time but human comprehension. The trend is shifting toward sharing 'Claude code artifacts' that explicitly lay out intent, trade-offs, and rationale alongside the code.

  3. Labs Structure for Rapid Iteration 19:13

    Anthropic Labs operates on a two-week 'persevere or pivot' cycle. Teams are assembled around 'bets,' and the structure deliberately avoids tying people to specific projects, allowing for quick disbandment and reassembly.

  4. Scaling Requires Pre-Measurement 23:50

    Drawing from Instagram's scaling experience, it is crucial to pre-measure everything that might be needed (metrics) and implement thoughtful knobs and feature flags for dynamic runtime configuration.

Watch on YouTube Full article

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩  and @swyxtv thumbnail

· 28:03

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩ and @swyxtv

The discussion explores the current state and future architectural challenges of frontier AI models. Key technical points covered include specialized hardware (e.g., Etched) optimizing for post-transformer workloads, the limitations of Large Language Models (LLMs) in achieving true recursive self-improvement (RSI), and the necessity for 'Agent Labs' to build model-agnostic applications that solve complex, last-mile problems.

Key takeaways

  1. The Value Proposition of AI Engineering Conferences 5:20

    AI conferences are becoming crucial neutral grounds where multiple frontier labs (like OpenAI) can compete on an even playing field, which is highly beneficial for engineers and competitive for the labs themselves. This contrasts with single-vendor events.

  2. Hardware Specialization vs. General Purpose AI 10:20

    New generation chips (like Etched) are optimizing specifically for post-transformer workloads and architectures (post RGBT), moving beyond the general focus of older specialized hardware like Cerebras.

  3. Architectural Limitations of LLMs 22:30

    LLMs are limited in their recursion because they tend to explore variations within known data distributions. True innovation and discovering 'unknown unknowns' still require dedicated research, suggesting a need for new architectural paradigms beyond current transformer models.

  4. The Future of Application Development 25:20

    Founders should focus on building 'Agent Labs'—being the AI layer for specific industries (e.g., lawyers, dentists). This strategy is resilient to model generalization and capability overhangs because it solves persistent, last-mile problems.

Watch on YouTube Full article