The Video Signal

Topic

Continual Learning

All digests tagged Continual Learning

· 48:41

Building AI That Learns and Adapts: A Case Study in MRI Diagnostics - Agata Chudzińska

This technical talk explores Continual Learning (CL), positioning it as a critical missing piece for building robust, adaptive AI systems. Using a case study in MRI diagnostics for detecting Focal Cortical Dysplasias (FCDs) in epilepsy patients, the speaker details how CL techniques mitigate issues like data drift and catastrophic forgetting. The presentation covers advanced ML architectures (Encoder-Decoder), preprocessing steps (e.g., segmentation, Junction/Extension filters), and three main CL methods: regularization-based, memory-based, and architecture-based. The goal is to enable models to adapt continuously in privacy-sensitive environments without requiring full retraining.

Key takeaways

  1. Continual Learning (CL) addresses core ML deployment challenges. 3:30

    CL allows AI models to learn and adapt over time from new data streams without forgetting previously acquired knowledge, solving issues like catastrophic forgetting and data drift. This is crucial for high-stakes fields like medicine.

  2. Medical imaging requires specialized preprocessing and architectures. 6:50

    For FCD detection from MRI scans, the process involves brain tissue segmentation and applying feature enhancement filters (e.g., Junction and Extension) before feeding data into an Encoder-Decoder variant of a neural network architecture.

  3. CL methods offer solutions for resource constraints. 10:05

    Instead of retraining from scratch (which is costly, time-consuming, and raises privacy concerns), CL utilizes regularization-based, memory-based, or architecture-based approaches to maintain performance while adapting to new tasks.

  4. The future of AI requires continuous adaptation. 20:05

    The speaker emphasizes that CL is not just a 'nice to have' feature but a strategic architectural choice for any production-level ML system dealing with evolving data and strict privacy requirements.

Watch on YouTube Full article

· 49:44

The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO

The talk addresses the limitations of current AI architectures—specifically that simply increasing context window size or relying solely on Retrieval-Augmented Generation (RAG) is insufficient for building truly intelligent, long-horizon agents. Dan Biderman introduces a paradigm shift focusing on 'continual learning' and knowledge compression. Key solutions include using specialized knowledge representations called 'cartridges,' implementing 'test-time training' (or test-time compute), and achieving high token efficiency to enable models to handle the anticipated petabytes of proprietary enterprise data.

Key takeaways

  1. Beyond RAG: The Need for Internalized Knowledge 15:14

    Current methods like RAG are limited because they only provide external, textual context. True intelligence requires embedding knowledge into the model's parameters (weights) to achieve 'intuition,' allowing the model to generalize and extrapolate beyond explicit notes or recipes.

  2. The Problem of Scale: Context Rot and Token Limits 23:30

    As companies accumulate trillions of tokens of proprietary data, simple context management fails due to 'context rot' (the model becoming less accurate the more context it reads) and extreme token consumption. This necessitates methods that are both highly efficient and scalable.

  3. The Solution Stack: Cartridges, Training, and Memory 30:05

    Engram proposes a multi-faceted approach combining knowledge compression via 'cartridges' (compact capsules of knowledge), gradient-based updates during inference ('test-time training'), and advanced memory layers to achieve superior token efficiency and model accuracy.

  4. The Future: Autonomous, Personalized AI

    The ultimate goal is a system where the model autonomously determines what knowledge should be internalized (in weights) versus what should remain external (in text/RAG), creating personalized models that improve continuously with user interaction, similar to nurturing a Tamagotchi.

Watch on YouTube Full article