Who’s afraid of an open-weight model? GLM, context bombing and post-Black Hat attacks
The discussion explores the rapid advancement and associated risks of open-weight AI models like GLM-5.3, which show strong capabilities in vulnerability discovery and validation. Defensively, researchers developed 'context bombing,' a technique using malicious prompts to shut down attacking AI agents. The conversation emphasizes that while offensive security (AI model development) is accelerating faster than defensive measures (automated patching/blue team), classic principles like defense-in-depth and assuming breach remain critical. Finally, the segment warns against sophisticated social engineering attacks targeting cybersecurity professionals post-conference.
Key takeaways
-
AI Vulnerability Discovery is Accelerating
2:00
Open-weight models like GLM-5.3 demonstrate advanced cyber capabilities through post-training, achieving a score of 84.5% on CyberGym for vulnerability discovery and validation, reaching parity with competitors like GPT Sol and Mythos.
-
Context Bombing as Defensive Measure
12:10
Tracebit researchers developed 'context bombing,' which uses malicious prompts placed alongside assets to confuse attacking AI agents. Testing showed that instances of models proceeding with an attack dropped from 91% to 15%.
-
Blue Team Must Match Offensive Pace
4:00
Experts stressed the need for significant investment in automated patching and blue team capabilities (e.g., automated SOC) to keep pace with AI-driven offensive security, noting that manual processes are insufficient.