Loading story…
Huntress tested Anthropic’s Claude Fable 5.1 on seven Rails coding tasks that required use of native framework APIs rather than functionally similar hand-written implementations. In 21 unguided trials, the agent selected the intended API 10 times (48%); it performed well on familiar APIs but failed to use perform_all_later, validates_comparison_of, and has_secure_token in any trial, despite solutions passing functional tests.
Adding a concise API-recall rule to CLAUDE.md raised intended API use to 86%. Huntress then combined a Rails-gem lookup utility with a second-model reviewer that could halt flawed output, achieving 28 successful outcomes in 28 trials. All resulting changes passed hidden RSpec tests, application tests, and RuboCop checks, with the additional controls estimated to cost roughly $0.30 per task.
Track how attackers are adapting to this technology.
2 events from the most recent confirmed update back to the earliest known activity.
Huntress evaluated an API-recall rule, Rails API lookup utility, and stop-time reviewer; the four-line CLAUDE.md rule increased recall to 18 of 21 trials (86%). Combining the rule, lookup tool, and reviewer produced 28 successful trials out of 28, with all solutions passing testing and lint checks.
Huntress tested Claude Fable 5.1 in a Rails application using seven API-recall tasks to measure whether it selected native Rails features rather than hand-written equivalents. In unguided trials, the agent used the intended APIs in 10 of 21 attempts (48%).
Follow how adversaries are adapting to this technology, and where it touches your stack today.
1 reference tracked. Mallory keeps watching after this page renders.
Map indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Anthropic’s **Claude Code Security** was introduced as an AI-driven capability within *Claude Code* that scans source code for vulnerabilities and proposes patches for human review, positioning itself as more adaptive than traditional rules-based static analysis. Coverage noted that early investor reaction briefly pressured major security vendors’ valuations, but analysts assessed the longer-term market impact as likely to be more nuanced given the feature’s early-preview status and its role as an add-on within a broader coding assistant/agent rather than a standalone security product. Separately, Mozilla engineers reported using **Claude** to help identify a “slew” of new Firefox issues, while also highlighting that a meaningful share of observed Firefox crashes may not be software defects at all but *hardware-induced memory errors* (“bit flips”). Mozilla cited roughly **470,000** weekly crash reports (from opted-in users), with about **25,000** flagged as potential bit flips (and possibly higher due to conservative heuristics), underscoring that AI-assisted bug-finding can improve software quality but may not address instability rooted in faulty or error-prone hardware (including potential causes like **Rowhammer** or defective components).
Jun 29, 2026
New benchmark results indicate that the framework surrounding an AI model is often the decisive factor in both cybersecurity and desktop automation tasks. On macOS, the **MacAgentBench** benchmark measured 676 tasks across 25 applications and found that Claude Opus 4.6 paired with the OpenClaw framework reached **73.7%** first-try success, while the same model using only screenshot-based mouse-and-keyboard control achieved **39.2%**; GPT-5.4 led bare-agent setups at **58.4%**. Researchers said much of OpenClaw’s advantage disappeared on tasks without prebuilt recipes, suggesting that skill libraries and task-specific scaffolding, rather than model quality alone, accounted for most of the gains. Reliability also remained uneven: the best setup completed **85.2%** of tasks at least once in four attempts but only **58.6%** correctly on all four runs. Cybersecurity-focused evaluations reported a similar pattern. Comparative reviews of **CyberMetric**, **NYU CTF Bench**, **InterCode CTF**, and **CAIBench** found that models perform well on knowledge-heavy tests but drop sharply on multi-step exploitation and attack-defense tasks, where success rates often fall into the **20–40%** range. A separate CyBench study discussed on r/netsec found no single scaffold dominated every challenge, while combining heterogeneous scaffolds and a shared blackboard architecture solved **19 of 33** tasks (**57.6%**) and reduced execution time. Safety findings also pointed to the harness as the main control point: one SkillHarness study said explicit skill boundaries and risk guards enforced user-consent and sensitive-data restrictions before execution, and that removing those boundaries increased attack success by **9.6 percentage points**. Across the studies, researchers warned that stronger automation without robust guardrails could enable unauthorized file access, credential harvesting, and other misuse.
Jul 10, 2026
Anthropic released **Claude Opus 4.6**, highlighting improved *agentic* coding performance (code review, debugging, and sustained work over large codebases) and expanded safety evaluation coverage. The company claims the model is better at finding real vulnerabilities in codebases and behaves more consistently on complex tasks, while maintaining low rates of misaligned behavior (e.g., deception) and reducing unnecessary refusals to benign requests. Anthropic also reported using Claude Opus 4.6 to identify **500+ previously unknown high-severity flaws** in widely used open-source libraries, including **Ghostscript**, **OpenSC**, and **CGIF**, and said the issues were validated to avoid hallucinations and have been patched by maintainers. The company described testing by its **Frontier Red Team** in a virtualized environment with access to tools like debuggers and fuzzers, aiming to measure the model’s out-of-the-box vulnerability discovery capability without specialized prompting or custom scaffolding, and using the model to help prioritize severe memory-corruption findings.
Jun 29, 2026