Loading story…
Major security vendors have significantly increased their investments in artificial intelligence (AI) security, with a surge in mergers and acquisitions (M&A) aimed at strengthening their capabilities to protect AI systems, applications, and workflows. Cisco initiated this trend by acquiring Robust Intelligence for $400 million, followed by at least eleven more acquisitions involving companies such as Cato Networks, Check Point, CrowdStrike, F5, and SentinelOne, who collectively spent over $1.3 billion to enhance their AI security portfolios. These acquisitions reflect the growing recognition of AI as a critical area for cybersecurity, especially as generative AI technologies like ChatGPT 3.5 have driven public and enterprise adoption. The focus of these deals spans runtime protections, prompt injection defenses, agent identity management, and output validation, as vendors seek to address the unique risks posed by AI systems. Concurrently, the enterprise sector is grappling with the expanded attack surface introduced by integrating AI into business operations, necessitating a strategic shift from traditional patchwork defenses to comprehensive, built-in security and safety measures. Enterprises are now required to evaluate threats such as software vulnerabilities, misconfigurations, broken authentication, and prompt injection attacks, all of which can compromise the confidentiality, integrity, and availability of AI systems. The distinction between AI security and AI safety is becoming more pronounced: while security focuses on defending systems from external threats, safety is concerned with ensuring AI systems behave as intended and remain aligned with organizational values. To address the challenge of AI safety, Anthropic has released an open-source tool called Petri, which uses AI agents to simulate interactions with frontier models and assess their propensity for risky behaviors such as deception, sycophancy, and power-seeking. Early tests of Petri on leading models like Claude Sonnet 4.5 and GPT-5 revealed that, although some models are safer than others, the ability of AI to discern and avoid harmful actions remains imperfect. The tool provides a framework for measuring and triaging safety risks, highlighting the need for both technical and governance solutions. As organizations deploy AI at scale, regulatory compliance and data governance are becoming integral to their security strategies, with vendors and enterprises alike recognizing that robust AI security and safety are essential for trustworthy and resilient AI adoption. The convergence of industry investment, new safety tools, and evolving enterprise risk management practices marks a pivotal shift in how the cybersecurity community approaches the protection and alignment of AI technologies. This mainstreaming of AI security is expected to continue as both the threat landscape and regulatory expectations evolve, driving further innovation and collaboration across the sector.
Track how attackers are adapting to this technology.
4 events from the most recent confirmed update back to the earliest known activity.
BankInfoSecurity reported that AI security had become a mainstream market segment, with vendors increasing spending on mergers and acquisitions to expand capabilities.
Red Hat published analysis arguing that enterprises should treat AI safety as part of the broader cybersecurity risk landscape, framing AI as a new risk frontier requiring integrated defenses.
ZDNet reported that Anthropic's open-source safety tool identified AI models exhibiting whistleblowing-like behavior in the wrong contexts, highlighting unintended safety and governance risks in model behavior.
Anthropic released an open-source safety tool intended to evaluate or improve AI model safety. The release became the basis for later reporting about unexpected model behavior uncovered by the tool.
Follow how adversaries are adapting to this technology, and where it touches your stack today.
3 references tracked. Mallory keeps watching after this page renders.
bankinfosecurity.com
Open sourcezdnet.com
Open sourceredhat.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Organizations are rapidly adopting artificial intelligence (AI) tools to enhance cybersecurity operations, streamline workflows, and improve productivity, but this trend introduces significant new risks and challenges. Reports indicate that cybersecurity professionals with AI security skills are in high demand, as companies seek to leverage AI for vulnerability management, threat detection, and automation of security tasks. The integration of AI into security teams’ arsenals is accelerating, with agentic AI tools becoming increasingly common for both defensive and operational purposes. However, the proliferation of AI-powered applications, such as AI notetakers in virtual meetings, raises concerns about data privacy, compliance, and the potential for sensitive information exposure. Many AI notetaking tools operate outside official enterprise systems, often lacking robust security controls such as SOC 2 certification, GDPR compliance, or strong encryption, making them vulnerable to data breaches and mishandling. The risk is compounded by the rapid spread of these tools within organizations, sometimes without proper vetting by legal, security, or procurement teams. Transcripts generated by these applications can be stored in third-party systems, increasing the risk of unauthorized access or legal discoverability. Security leaders are advised to develop clear policies and governance frameworks to manage the use of AI tools, ensuring that only approved applications with adequate security measures are deployed. The evolving landscape of AI in cybersecurity also includes increased merger and acquisition activity, as companies seek to acquire innovative AI security capabilities. Industry analysis highlights the need for continuous evaluation of AI models, such as DeepSeek, and the security implications of open-source agent frameworks like OpenAI’s AgentKit. The impact of AI-generated code on application security is another emerging concern, as automated code generation can introduce vulnerabilities if not properly reviewed. As AI becomes more embedded in business processes, organizations must balance the benefits of automation and efficiency with the imperative to safeguard sensitive data and maintain regulatory compliance. Security teams are encouraged to stay informed about the latest trends in AI security, invest in upskilling staff, and implement layered defenses to mitigate the unique risks posed by AI-driven tools. The convergence of AI and cybersecurity is reshaping the threat landscape, requiring proactive risk management and strategic investment in secure AI adoption.
Jun 29, 2026
Enterprises are rapidly adopting agentic AI technologies to automate and enhance both security operations and business-to-business (B2B) workflows, fundamentally transforming traditional IT and security architectures. Security Operations Centers (SOCs) are experiencing unprecedented alert volumes, with large organizations managing thousands of alerts daily, leading to significant alert fatigue and missed incidents. To address these challenges, organizations are shifting from legacy, manual SOC models to AI-augmented SOCs, where analysts oversee and validate AI-driven decisions rather than manually triaging every alert. This transition requires a mindset shift, as leaders must learn to trust AI systems to assist analysts without fully replacing human judgment. The adoption of AI in SOCs is accelerating, with 88% of organizations planning to evaluate or deploy AI-driven SOC platforms within the next year. However, the proliferation of AI-powered SOC automation introduces new risks, making it essential for security leaders to carefully assess architectures, implementation models, and phased adoption strategies. In parallel, agentic AI is revolutionizing SaaS and partner ecosystems by enabling autonomous, self-orchestrating integrations that move beyond traditional, human-mediated application networks. This shift is driving a critical pivot in enterprise technology, as routine, rules-based digital tasks become candidates for full automation by intelligent agents. As these autonomous AI agents automate complex B2B workflows, robust security and governance frameworks become paramount. Security experts emphasize the need to integrate AI agents with existing enterprise governance platforms, ensuring alignment with established security practices such as Role-Based Access Control (RBAC) and organizational policy management. The introduction of AI firewalls and guardrails—context-aware frameworks that verify both the inputs and outputs of AI agents—provides a foundational layer of security, ensuring that automated actions remain compliant with enterprise policies. Verifiable workflows are crucial, particularly in B2B environments, to maintain operational coherence and prevent unauthorized or unintended actions by autonomous agents. The convergence of these trends highlights the dual imperative for organizations: to harness the efficiency and scalability of agentic AI while implementing rigorous security controls and governance mechanisms. As AI becomes integral to both security operations and business workflows, the ability to measure real impact, manage risks, and select the right platforms will define organizational resilience. Security teams and platform architects must stay informed about evolving best practices for securing AI and large language models (LLMs) within their environments. Ultimately, the successful adoption of agentic AI in the enterprise hinges on balancing innovation with robust, context-aware security and governance.
Jun 29, 2026
AI is rapidly transforming the cybersecurity landscape, introducing both significant risks and powerful new defensive capabilities. The widespread adoption of AI tools in the workplace has led to a surge in employees using these technologies, with 65% of people now utilizing AI tools, up from 44% the previous year. However, this increased usage has not been matched by adequate security training, as 58% of employees have received no instruction on AI security or privacy risks. This gap has resulted in sensitive business information, including internal documents, financial data, and client details, being routinely entered into AI systems, raising the risk of data leakage and unauthorized access. Employees express substantial concern about AI's potential to amplify cybercrime, facilitate scams, bypass security systems, and enable identity impersonation, yet only 45% trust companies to implement AI securely. In parallel, AI is being leveraged by both attackers and defenders, with advanced models now capable of simulating and even outperforming human teams in vulnerability discovery and remediation. For example, AI models have been used to replicate major historical cyberattacks in simulation, demonstrating their potential for both offensive and defensive applications. In cybersecurity competitions, AI-driven systems have successfully identified and patched vulnerabilities, sometimes uncovering previously unknown flaws. Organizations like Anthropic have invested in enhancing their AI models to assist defenders, enabling the detection, analysis, and remediation of vulnerabilities in both code and deployed systems. These advancements have led to AI models matching or surpassing previous state-of-the-art systems in cyber defense tasks. At the same time, threat actors are exploiting AI to scale their operations, prompting security teams to develop new safeguards and monitoring techniques. The dual-use nature of AI in cybersecurity underscores the urgent need for robust security awareness training, updated policies, and technical controls to manage the risks associated with AI adoption. As AI continues to evolve, defenders must stay ahead by integrating AI-driven tools into their security operations while remaining vigilant against emerging threats. The current state of AI security is described as precarious, with urgent calls for organizations to address the human and technical factors contributing to risk. The future of cybersecurity will be defined by the ongoing arms race between AI-powered attackers and increasingly sophisticated AI-enabled defenders, making continuous adaptation and investment in AI security essential for organizational resilience.
Jun 29, 2026