Skip to main content
Mallory
← Back to News
ai-platform-securitystandards-framework-update

Aikido Benchmark Finds GPT-5.6 Leads AI Rediscovery of Known CVEs

Emerging Technology Risk · 2 sources · Updated 4mo ago · First seen Jul 20, 2026

Aikido Benchmark Finds GPT-5.6 Leads AI Rediscovery of Known CVEs

Aikido Security published a benchmark of 13 AI models measuring their ability to rediscover 26 known vulnerabilities from the GitHub Advisory Database using an AI code analysis harness aimed directly at vulnerable code snippets. GPT-5.6 posted the highest pooled recall, finding 23 of 26 CVEs, followed by grok-4.5 with 20, while Claude Opus variants scored between 15 and 18 and GLM-5.2 reached 16. Across the test set, all models consistently identified the obvious critical cases, showing that short and recognizable exploit paths remain easier for current models to detect.

The biggest gaps appeared on higher- and medium-severity flaws that required deeper reasoning across indirect code paths or missing validation checks, including complex chains such as SQL injection tied to unescaped ORM column aliases. The evaluation also highlighted significant run-to-run variance and found that pooling repeated runs of cheaper mid-tier models, such as pass@3 testing, often matched or exceeded the value of a single run from more expensive flagship reasoning tiers at substantially lower cost, suggesting that benchmarking methodology and harness design materially influence reported vulnerability-detection performance.

New surface, new adversariesTrack how attackers are adapting to this technology.
Track this risk
Event timeline

How this story unfolded

Events from the most recent confirmed update back to the earliest known activity.

1 event · Jul 16, 2026
  1. Jul 16, 20264mo ago

    Aikido Security publishes AI model CVE rediscovery benchmark

    On July 16, 2026, Aikido Security published research benchmarking 13 AI models on rediscovering 26 known vulnerabilities from the GitHub Advisory Database using its AI Code Analysis harness. The study reported GPT-5.6 with the highest pooled recall at 23 of 26 CVEs and highlighted cost-performance tradeoffs, including repeated runs of cheaper models outperforming some single runs of flagship models.

    Benchmarking 13 AI Models on Known CVE Detection
Linked entities

Related entities

Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.

Open in app →

Organizations

1 linked
Aikido Security
Do you run this?Follow how adversaries are adapting to this technology, and where it touches your stack today.
Track This Risk
Mallory platform

See the full picture, correlated to your attack surface.

This page covers what’s public. Mallory adds the parts that aren’t: which of your assets are affected, which threat actors are using it right now, and what to deploy next.

Exposure mappingMap indicators from this story to your assets and identify affected systems in minutes.
Threat actor evidenceEvery observed campaign, victim, and pivot linked to actors named in this story.
Associated malwareMalware, exploits, and IOCs connected to the activity described here.
Detection signaturesYARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Scheduled alertsGet matching new stories delivered to your team as they break, not the next morning.
AI threadsAsk questions about this story and take action on the answers.