Data Engineering — The Video Signal

Aug 4, 2026 · 13:55

What Are Large Database Models? AI for SQL Data

Large Database Models (LDMs) represent a significant advancement in applying AI to enterprise data by bringing semantic capabilities directly into SQL and relational databases. Unlike Large Language Models (LLMs), which train on general text, LDMs are trained specifically on selected tables or views within a structured database. This allows organizations to unlock the estimated 99% of critical business data—often locked behind encryption and access controls—without needing to move it.

Key takeaways

LDM Functionality vs. Traditional SQL 2:15
Traditional methods require data scientists to manually write rigid SQL filters (e.g., `where age is between 20 and 40`) and move data to an analytics platform, which is slow and expensive. LDMs use vector representations learned from co-occurring values across columns to perform semantic queries, eliminating the need for manual field selection or guessing constraints.
Core LDM Capabilities 3:30
LDMs enable advanced querying capabilities such as finding customer similarity (finding customers 'most similar' to a given ID), identifying unusual transactions (fraud detection), and exploring product relationships, all executed via standard SQL against the database itself.
Commercial Availability 9:00
IBM launched the first LDM-based database product, 'SQL Data Insights,' which ships as part of DB2 for ZOS. A follow-up version, 'SQL Data Insights Pro,' extends this approach to unstructured text and adds incremental model refresh.

Watch on YouTube Full article

Jul 31, 2026 · 19:05

Data Quality Is the Compute Multiplier — Ari Morcos, DatologyAI

In an era of increasing compute scarcity—evidenced by rising H100 prices and skyrocketing token usage—data quality has emerged as the critical 'compute multiplier' for model training. The presentation outlines a systematic approach to data enhancement through four stages: Clean, Curate, Create, and Compose. By maximizing the signal per token (marginal information gain), organizations can achieve performance levels comparable to models trained with vastly more compute budgets. Practical applications include improving Vision Language Models (VLMs) and enhancing multilingual capabilities using proprietary or public datasets.

Key takeaways

Compute Scarcity Drives Data Focus
The availability of compute is becoming increasingly constrained, leading to market actions like Google capping Meta's Gemini usage and OpenAI selling token futures. This necessitates a shift in focus from raw compute power to data quality.
Data Quality as Compute Multiplier 3:39
Improving data quality allows for dramatically better performance (blue curve) compared to training with the same limited compute budget (gray curve), effectively simulating much larger compute investments.
The Four C's of Data Enhancement 5:48
Data improvement is achieved through a pipeline: Clean (heuristic filters, decontamination), Curate (quality classifiers, redundancy reduction), Create (synthetic data generation/rephrasing), and Compose (sequencing across multiple training stages).
Cross-Lingual Benefits from Curation 15:24
Curating English data can positively benefit non-English performance, demonstrating cross-lingual transfer. Similarly, curating non-English data benefits English performance.

Watch on YouTube Full article

Jul 31, 2026 · 18:20

Learning on the Job: The Future of Post-Training — Raymond Feng, Applied Compute

The presentation outlines a vision for advanced AI agents that can continuously learn and adapt in real-world enterprise environments post-deployment. The core methodology involves an orchestrated training loop: interactions are captured by an orchestrator, processed through inference engines, graded, and the resulting data (graded chats/traces) is fed into a training engine to compute weight updates. Key challenges addressed include environment fidelity, preventing reward hacking, and transitioning from controlled, replayable synthetic environments to uncontrolled, off-policy production data.

Key takeaways

The Progression of Agent Training
Agent training moves from simple single-turn Q&A tasks (controlled by a dedicated training stack) to complex, multi-turn, long-horizon tasks that require offloading environment state outside the training stack.
The Core RL Training Loop
Training relies on an orchestrator driving rollouts, which sends prompts to a model and then passes results to a grader. The resulting graded chats are used by a training engine to compute weight updates for the inference engines.
Addressing Real-World Data Challenges 15:45
Replicating production environments is difficult due to issues like non-replayability and off-policy data. The future requires methods like automated data pipelines and qualitative feedback ingestion to learn from real interactions.
The Vision: Self-Improving Agents
The ultimate goal is a single deployment model that can interact across many different settings, continuously self-evaluating and computing weight updates from every interaction it has.

Watch on YouTube Full article

Jul 31, 2026 · 17:45

The Base Model Is Dead — Varun Singh, Arcee AI

The traditional paradigm of viewing a base language model as merely a reflection of the entire human web is obsolete. As LLMs advance toward complex reasoning and agentic behavior (e.g., interacting with software environments), the training focus shifts from raw web text to incorporating instruction data, synthetic reasoning traces, and post-training techniques earlier into the pre-training phase. This requires careful management of data mixes, load balancing coefficients (especially in MOEs), and establishing stable representations early on.

Key takeaways

The Decline of Raw Web Text 2:10
Historically, models like GPT-3 relied heavily on raw web scrapes (e.g., Common Crawl/WebText-2), which constituted up to 85% of the training data. Modern recipes show a significant decrease in web text's proportion, indicating that its value is diminishing relative to code and structured reasoning abilities.
Shift from Knowledge Prior to Capability Prior 8:00
The base model's role is changing from accumulating general world knowledge (the 'prior') to carrying the necessary prior for complex Reinforcement Learning (RL) tasks. RL is no longer a mere 'cherry on top,' but a core component that requires the base model to be prepared for advanced composition and reasoning.
Synthetic Data Integration 11:20
A key trend involves pulling post-training data (like SFT/Q&A chat data) and large-scale synthetic data back into the pre-training phase. This allows models to learn task representations, conversation shapes, and atomic skills from the very beginning.

Watch on YouTube Full article