OpenAI Astra and Recurrent Depth / Looped Transformers
This video explains looped transformers—a technique to scale LLM depth by reusing weights multiple times. We analyze fixed repetition (Nanbeige4.2-3B) vs. dynamic Mixture-of-Recursions.
Read article