Anthropic Tightens AI Cyber Controls With Safeguards and Jailbreak Bounty

Anthropic introduced real-time cyber safeguards for its Claude Opus and Sonnet models that automatically block prompts tied to prohibited or high-risk cyber activity, including mass data exfiltration and ransomware development. The company said some dual-use requests, such as vulnerability exploitation or offensive security tooling, may still be permitted through its application-based Cyber Verification Program, which is intended for vetted defensive security professionals and is not currently available for Zero Data Retention users or through Amazon Bedrock and Google Vertex AI.

Anthropic also launched a HackerOne program to reward researchers who find high-impact jailbreaks that let Claude Fable 5 generate exploit code, malware, or detailed attack guidance it would normally refuse. The moves come amid broader industry concern that advanced models can sharply reduce the time and skill needed for offensive cyber work, while related reporting tied Anthropic’s vulnerability-discovery efforts to IBM and Red Hat’s new Project Lightwell, a $5 billion service aimed at backporting and delivering signed fixes for open-source flaws uncovered faster than enterprises can patch them.