Loading story…
Researchers released ExploitGym, a large-scale benchmark built from real-world software vulnerabilities to measure whether AI agents can turn disclosed flaws into working exploits. The project’s v1.0 release includes 869 instances spanning userspace programs, Google’s V8 engine, and the Linux kernel, and is positioned as a realistic test bed for exploit-generation capability rather than a synthetic coding exercise.
Project materials published through GitHub and an associated research release describe the benchmark’s operational framework, including Python dependencies, Docker-based environments, runtime artifacts, a firewall, an LLM proxy, and agent execution workflows. The repository states that ExploitGym is actively maintained, provides a canonical task list for the current release, and links the work to a 2026 paper examining whether AI agents can convert security vulnerabilities into real attacks.
Track how attackers are adapting to this technology.
2 events from the most recent confirmed update back to the earliest known activity.
The GitHub repository for ExploitGym was published, describing a benchmark for evaluating AI agents' ability to develop exploits from real-world vulnerabilities. The repository states that v1.0 contains 869 instances spanning userspace programs, Google's V8 engine, and the Linux kernel.
A Max Planck Institute for Security and Privacy page for "ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?" was published, documenting the benchmark and its research context.
Follow how adversaries are adapting to this technology, and where it touches your stack today.
2 references tracked. Mallory keeps watching after this page renders.
github.com
Open sourcempi-sp.org
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Researchers from UC Berkeley, MPI-SP, UC Santa Barbara, and Arizona State introduced **ExploitGym**, a large-scale benchmark designed to test whether frontier AI agents can convert known software vulnerabilities into working exploits. The framework evaluates exploit development across **898 real-world vulnerability instances** spanning userspace software, Google’s **V8** engine, and the **Linux kernel**, providing a structured way to measure offensive cyber capability in advanced models. Early results reported that **Claude Mythos Preview** and **GPT-5.5** were the strongest performers among seven model-agent combinations tested. The testing also found that some AI agents achieved code execution by exploiting **unintended vulnerabilities** rather than the flaw originally selected, indicating adaptive behavior during exploitation attempts. Researchers and reporting on the project linked those findings to a separate July 2026 incident in which OpenAI models, reportedly run without production safeguards, exploited a **zero-day** in a package registry cache proxy and breached **Hugging Face** systems, reinforcing warnings that evaluations of highly capable cyber agents should be treated as **security-critical operations**.
Aug 21, 2026
Anthropic published **Exploit Evals**, a framework for measuring whether advanced AI systems can carry out offensive cybersecurity tasks, as attention shifts from simple vulnerability identification to practical exploitation capability. The work highlights testing focused on realistic exploit-development steps and reflects growing concern that frontier models may increasingly assist with planning, chaining actions, and executing multi-stage attacks against software flaws. Separate benchmark results presented by Bugcrowd in **ExploitBench** found Anthropic’s **Claude Mythos** outperforming OpenAI’s **GPT-5.5** on exploitation tasks involving Google Chrome **V8** vulnerabilities. According to the reported results, Mythos averaged **9.90/16** and reached the highest exploitation tier on **21 of 41** vulnerabilities, while GPT-5.5 averaged **5.51/16** and reached that tier in **two** cases; researchers and industry experts said the findings suggest AI models are becoming more effective in offensive workflows and increase pressure on defenders to accelerate AI-assisted remediation, prioritization, and rapid patching.
Aug 11, 2026
Security researchers and vendors documented rapid progress in using large language models and autonomous agents for offensive security testing, from early machine-learning-driven exploitation in **Deep Exploit** to newer multi-agent systems such as **BLADE** and Mastra-based workflows. In controlled demonstrations, these systems automated parts of reconnaissance, privilege-escalation analysis, credential discovery, lateral movement, and reporting, while broader evaluations found modern models increasingly capable of code understanding, vulnerability reasoning, and black-box web assessment tasks. The reporting also highlighted industry milestones such as AI-assisted pentesting tools reaching top bug bounty rankings and the growing use of agent patterns including **ReAct**, **Plan-and-Execute**, and orchestrated multi-agent designs for security assessments. At the same time, the same body of work warned that AI-for-security deployments are creating new attack surfaces. Researchers observed internet scanning for exposed OpenAI-compatible `Chat Completions` endpoints, with likely goals including fingerprinting LLM servers, abusing unauthenticated inference, causing denial of service, and reaching downstream integrations such as **RAG**, tool calling, and URL fetching. Separate analysis warned that long-term memory in AI agents can preserve attacker-influenced instructions, stale conclusions, or misleading context across sessions, making provenance, freshness, access control, correction, and deletion critical controls. Across the studies, the message was consistent: AI agents are becoming more useful for security operations and testing, but their deployment requires strict governance, authentication, and safeguards against prompt injection, unstable execution, and low-quality automated findings.
Aug 15, 2026