State of Data — Sean Cai, Independent / State of Data
The data market is undergoing a structural shift from relying on sheer quantity of annotated images (the 'least interesting part') to capturing high-quality, process-based expertise. Data's value lies in the trajectory and reasoning trace—not just the final output. The speaker argues that while model improvement requires balancing compute, data, and talent, data remains the most underfunded leg. Successful companies must pivot from being mere 'data businesses' to becoming infrastructure providers (neo-labs) that build robust pipelines into real-world work.
Key takeaways
-
Data Shift: From State to Process
2:08
The most valuable data is process-based data—the reasoning trace or sequence of decisions, rather than state-based data (e.g., rows in an ERP). Type one data (pure capture of real workflows like GitHub commits) offers superior realism compared to type two data (contrived examples manufactured by experts).
-
The Importance of Verifiability
5:50
A task's ease of training is proportional to its verifiability, which depends on three axes: asymmetry of verification (decomposability into checkable steps), veracity of verification (consensus on what 'correct' means), and proliferation of verification (availability of fresh examples). Coding scored highly because it solved all three.
-
The Builder's Moat is the Pipeline
13:10
For data companies, the durable value accrues to the services and application layer of actual work. The true moat for builders is not the raw data itself, but the pipeline into real-world work and the infrastructure required to keep retraining as models improve.