Intelligence + Continual Learning = Expertise — Yu Su, NeoCognition
The talk distinguishes between 'Intelligence' (the capacity to reason through unfamiliar problems from available context) and 'Expertise' (accumulated, situated competence). While modern LLM agents excel at symbolic tasks like coding because code is a structured language-native world, they struggle in heterogeneous real-world digital environments. The speaker posits that this difficulty represents a modern Moravec's paradox. To scale AI beyond basic capability, systems must implement continual learning to acquire specialized expertise for each 'microworld,' leading toward 'unbounded expertise from bounded intelligence.'
Key takeaways
-
Intelligence vs. Expertise Distinction
3:50
Intelligence is the ability to reason through novel problems given context, while expertise is accumulated competence that allows for efficient action and judgment in a specific domain (e.g., recognizing constraints beyond just finding a shared calendar slot).
-
The Coding Agent Advantage
5:26
Coding is an ideal first market for LLM agents because code is already symbolic and structured, providing clear tests and rewards. Leaving this 'privileged world of code' introduces significant brittleness.
-
The Role of Continual Learning
10:44
Continual learning is defined as the adaptive compression of experience into reusable structures for future behavior. It is presented as the critical bridge needed to transition from raw intelligence (brute-forcing solutions) to specialized expertise (compressing the search space).