AI Exploit Benchmarks Show Frontier Models Advancing on Real-World Vulnerabilities
Emerging Technology Risk · 2 sources · Updated 3mo ago · First seen Aug 11, 2026

Anthropic published Exploit Evals, a framework for measuring whether advanced AI systems can carry out offensive cybersecurity tasks, as attention shifts from simple vulnerability identification to practical exploitation capability. The work highlights testing focused on realistic exploit-development steps and reflects growing concern that frontier models may increasingly assist with planning, chaining actions, and executing multi-stage attacks against software flaws.
Separate benchmark results presented by Bugcrowd in ExploitBench found Anthropic’s Claude Mythos outperforming OpenAI’s GPT-5.5 on exploitation tasks involving Google Chrome V8 vulnerabilities. According to the reported results, Mythos averaged 9.90/16 and reached the highest exploitation tier on 21 of 41 vulnerabilities, while GPT-5.5 averaged 5.51/16 and reached that tier in two cases; researchers and industry experts said the findings suggest AI models are becoming more effective in offensive workflows and increase pressure on defenders to accelerate AI-assisted remediation, prioritization, and rapid patching.


