Latent Space

A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI

Published 2026-09-18 · Duration 1:09:52

Summary

Liquid AI presents a comprehensive view of the next generation of AI architectures, moving beyond pure Transformer models. Their approach is inspired by biological systems, specifically the continuous-time dynamics of worms, leading to the development of Liquid Neural Networks (LNNs). The company emphasizes a 'meta AI' system that systematically searches for hybrid, hardware-aware architectures (e.g., combining convolutions, attention, and LNN elements) to achieve high quality while minimizing memory and latency. A major focus is enabling reliable, high-intelligence deployment at the edge (on-device, in cars, and on laptops), addressing critical needs for privacy, cost efficiency, and air-gapped capabilities.

Download summary

Key takeaways

  1. Biological Inspiration and Continuous Dynamics 1:55

    Liquid AI's foundational research is inspired by the worm's nervous system, which uses simple first-order differential equations. This leads to Liquid Neural Networks (LNNs), which are continuous-time, differentiable systems, allowing for backpropagation and learning while maintaining biological fidelity. (01:15-02:00)

  2. Architectural Search for Efficiency 4:20

    Instead of committing to a single architecture, Liquid uses a meta AI system to search for optimal hybrid architectures. This search optimizes four criteria: no sacrifice on quality, minimizing memory consumption, minimizing latency, and maximizing computation speed, making the models hardware-aware. (04:20-05:30)

  3. Edge and On-Device Intelligence 8:20

    The company is focused on bringing high-quality intelligence outside of data centers (e.g., cars, laptops, mobile devices). This is driven by cost considerations and the need for enhanced privacy, enabling local, air-gapped capabilities. (08:20-09:30)

  4. The Future of AI: Multimodality and Adaptability 12:40

    Future research focuses on massively multimodal systems (audio, vision, text, DNA) and achieving 'adaptive intelligence'—systems that can combine forward and backward passes simultaneously, moving beyond static training paradigms. (12:40-13:30)

Technical details

  • Liquid Neural Networks (LNNs) 190s

    LNNs are continuous-time dynamical systems that model how neurons exchange information using differential equations. They are differentiable, enabling standard optimization techniques like backpropagation. (01:30-02:00)

  • State Space Models (SSMs) 330s

    SSMs are presented as a linear version of recurrent neural networks, allowing for the parallelization of operations (like parallel scan) which is crucial for scaling computation on modern hardware. (05:30-06:30)

  • Model Scaling and Architecture Search 260s

    The process involves using a meta AI search algorithm to build hybrid architectures (e.g., combining convolutions and attention) that are optimized for specific deployment environments (e.g., CPUs). The current models range from 100 million to 24 billion parameters. (04:20-05:30)

  • Deployment Formats and Tools 600s

    The company provides tools like 'Leap' to allow developers to extract inference-ready bundles in formats like GGUF, enabling deployment on resource-constrained devices (e.g., CPUs). (09:50-10:30)

Mentioned resources

  • Liquid AI (Company/Model Family)
  • Liquid Foundation Models (LFM) (Model Family)
  • LFM2 / LFM2.5 (Model Version)
  • AMD (Hardware Partner)
  • Shopify (Enterprise Partner)

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.