Skip to main content
Mallory
← Back to News
ai-enabled-threat-activityadversary-emulation-tradecraftoffensive-tooling-releaseendpoint-software-vulnerability

AI Exploit Benchmarks Show Frontier Models Advancing on Real-World Vulnerabilities

Emerging Technology Risk · 2 sources · Updated 3mo ago · First seen Aug 11, 2026

AI Exploit Benchmarks Show Frontier Models Advancing on Real-World Vulnerabilities

Anthropic published Exploit Evals, a framework for measuring whether advanced AI systems can carry out offensive cybersecurity tasks, as attention shifts from simple vulnerability identification to practical exploitation capability. The work highlights testing focused on realistic exploit-development steps and reflects growing concern that frontier models may increasingly assist with planning, chaining actions, and executing multi-stage attacks against software flaws.

Separate benchmark results presented by Bugcrowd in ExploitBench found Anthropic’s Claude Mythos outperforming OpenAI’s GPT-5.5 on exploitation tasks involving Google Chrome V8 vulnerabilities. According to the reported results, Mythos averaged 9.90/16 and reached the highest exploitation tier on 21 of 41 vulnerabilities, while GPT-5.5 averaged 5.51/16 and reached that tier in two cases; researchers and industry experts said the findings suggest AI models are becoming more effective in offensive workflows and increase pressure on defenders to accelerate AI-assisted remediation, prioritization, and rapid patching.

New surface, new adversariesTrack how attackers are adapting to this technology.
Track this risk
Event timeline

How this story unfolded

Events from the most recent confirmed update back to the earliest known activity.

3 events · May 2026 – Jun 2026
  1. Jun 2026

    Bugcrowd presents initial ExploitBench results at Infosecurity Europe 2026

    At Infosecurity Europe 2026, Bugcrowd presented early ExploitBench findings from tests against a vulnerable Chrome V8 build. In the reported runs, Anthropic's Claude Mythos outperformed OpenAI's GPT-5.5, averaging 9.90 versus 5.51 and reaching the highest exploitation tier on 21 of 41 vulnerabilities versus two of 41.

    Mythos Outperforms GPT5.5 on Google Chrome Vulnerability Exploits - Infosecurity Magazine
  2. May 2026

    Bugcrowd releases RL environments alongside ExploitBench

    Bugcrowd released reinforcement learning environments alongside ExploitBench to help measure and improve model exploitation capability. This accompanied the benchmark's rollout.

    Mythos Outperforms GPT5.5 on Google Chrome Vulnerability Exploits - Infosecurity Magazine
  3. May 2026

    Bugcrowd launches ExploitBench benchmark

    Bugcrowd launched ExploitBench in collaboration with Carnegie Mellon University experts and Chrome vulnerability researchers. The benchmark was designed to measure whether AI models can exploit real-world vulnerabilities step by step rather than only identify them.

    Mythos Outperforms GPT5.5 on Google Chrome Vulnerability Exploits - Infosecurity Magazine
Linked entities

Related entities

Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.

Open in app →

Organizations

3 linked
AnthropicBugcrowdOpenai
Do you run this?Follow how adversaries are adapting to this technology, and where it touches your stack today.
Track This Risk
Mallory platform

See the full picture, correlated to your attack surface.

This page covers what’s public. Mallory adds the parts that aren’t: which of your assets are affected, which threat actors are using it right now, and what to deploy next.

Exposure mappingMap indicators from this story to your assets and identify affected systems in minutes.
Threat actor evidenceEvery observed campaign, victim, and pivot linked to actors named in this story.
Associated malwareMalware, exploits, and IOCs connected to the activity described here.
Detection signaturesYARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Scheduled alertsGet matching new stories delivered to your team as they break, not the next morning.
AI threadsAsk questions about this story and take action on the answers.