Aikido Benchmark Finds GPT-5.6 Leads AI Rediscovery of Known CVEs
Emerging Technology Risk · 2 sources · Updated 4mo ago · First seen Jul 20, 2026

Aikido Security published a benchmark of 13 AI models measuring their ability to rediscover 26 known vulnerabilities from the GitHub Advisory Database using an AI code analysis harness aimed directly at vulnerable code snippets. GPT-5.6 posted the highest pooled recall, finding 23 of 26 CVEs, followed by grok-4.5 with 20, while Claude Opus variants scored between 15 and 18 and GLM-5.2 reached 16. Across the test set, all models consistently identified the obvious critical cases, showing that short and recognizable exploit paths remain easier for current models to detect.
The biggest gaps appeared on higher- and medium-severity flaws that required deeper reasoning across indirect code paths or missing validation checks, including complex chains such as SQL injection tied to unescaped ORM column aliases. The evaluation also highlighted significant run-to-run variance and found that pooling repeated runs of cheaper mid-tier models, such as pass@3 testing, often matched or exceeded the value of a single run from more expensive flagship reasoning tiers at substantially lower cost, suggesting that benchmarking methodology and harness design materially influence reported vulnerability-detection performance.


