AI Agents in Cybersecurity: Automation and Human Oversight
Emerging Technology Risk · 3 sources · Updated 5mo ago · First seen Nov 24, 2025

Amazon has developed an internal system called Autonomous Threat Analysis (ATA), which leverages multiple specialized AI agents to proactively identify vulnerabilities, perform variant analysis, and propose remediations for its platforms. ATA, originating from an internal hackathon, operates by having AI agents compete in teams to investigate real attack techniques and suggest security controls, with all recommendations subject to human review. This approach aims to address the challenge of keeping detection capabilities current in a rapidly evolving threat landscape, enhancing the speed and coverage of security testing without removing human oversight from critical decision-making.
Separately, research from Anthropic highlights that while AI attack agents can automate and accelerate many tactical aspects of cyberattacks—such as generating scripts, testing exploits, and scanning configurations—they do not operate as fully autonomous weapons. Human operators remain responsible for strategic decisions, campaign design, and risk assessment, with AI serving as an accelerator rather than a replacement. Both cases underscore that current AI systems in cybersecurity amplify human expertise and efficiency but do not independently conduct or direct cyber operations.


