Topic

Autoregressive Generation

All digests tagged Autoregressive Generation

Suggested route

Topic journey

Move from earlier context through the available material to the newest signals. This route is a reading aid, not a difficulty ranking.

Start here

Build A Reasoning Model Scratch 2: Loading a Base Model, Text Generation, and KV Caching Sep 6, 2026 · 1:36:42 This deep dive covers loading pre-trained LLMs (Qwen3), implementing autoregressive text generation in PyTorch, and optimizing performance using KV caching and torch.compile for maximum inference speed.

Sebastian Raschka

Build A Reasoning Model Scratch 2: Loading a Base Model, Text Generation, and KV Caching

This deep dive covers loading pre-trained LLMs (Qwen3), implementing autoregressive text generation in PyTorch, and optimizing performance using KV caching and torch.compile for maximum inference speed.

Read article