Loading story…
Organizations are facing a surge in AI-driven threats, including the use of deepfakes and malicious AI-branded mobile applications, which are being leveraged by attackers to bypass traditional security controls and exploit brand trust. Deepfake technology is now operationally used for fraud, with attackers employing generative AI to create convincing synthetic identities that can deceive employees and systems, resulting in significant financial losses. Detection tools often lag behind, as they are unable to keep pace with new, sophisticated fakes, and human detection rates remain low, leaving enterprises vulnerable to rapidly evolving AI-enabled social engineering attacks.
Simultaneously, the proliferation of AI-branded mobile apps has created new attack vectors, with cloned or maliciously modified applications harvesting data, delivering adware, or embedding spyware on endpoints. Compounding these risks, many organizations are struggling with the rise of "shadow AI," where employees circumvent security controls to use unauthorized AI tools, undermining visibility and increasing exposure to unmonitored threats. Security leaders are urged to move beyond simple detection and blocking strategies, adopting adaptive, real-time verification and comprehensive risk management approaches to address the multifaceted challenges posed by AI in the enterprise.
Track how attackers are adapting to this technology.
1 event from the most recent confirmed update back to the earliest known activity.
Initial story creation
Follow how adversaries are adapting to this technology, and where it touches your stack today.
3 references tracked. Mallory keeps watching after this page renders.
securityboulevard.com
Open sourcezimperium.com
Open sourcesecuritysenses.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Enterprises are rapidly integrating artificial intelligence (AI) into their core operations, leading to a significant increase in both the scale and complexity of cybersecurity risks. Autonomous AI agents, once limited to providing suggestions, now act independently within enterprise systems, accessing sensitive data, executing transactions, and triggering downstream workflows without human oversight. These agents, often deployed by individual teams or embedded in third-party software, can inadvertently ingest confidential information, such as customer credit card data, even if the data is only briefly accessible. Unlike human users, AI agents lack contextual understanding and ethical judgment, acting continuously and at scale, which introduces a new category of 'Shadow AI' risk. Multimodal AI systems, which process multiple input streams to generate more human-like outputs, further expand the attack surface. Adversaries can exploit these systems by manipulating data inputs, such as subtly altering images or text, to deceive the AI and bypass security controls. Research has demonstrated that these attacks are not merely theoretical; adversarial manipulations can evade detection and cause significant harm, especially in critical sectors like defense, healthcare, and finance. Organizations are increasingly aware of the dangers posed by AI-augmented threats, including deepfakes and AI-driven social engineering, but many lag in implementing effective technical defenses. Surveys indicate that while a majority of firms have experienced deepfake or AI-voice fraud attempts, more than half have suffered financial losses as a result. Despite this, investment in detection and mitigation technologies remains inadequate, and many companies overestimate their preparedness. The surge in AI adoption is reflected in corporate disclosures, with over 70% of S&P 500 firms now reporting AI as a material risk, up from just 12% two years prior. Reputational and cybersecurity risks are the most frequently cited concerns, followed by legal and regulatory challenges as governments move to establish AI-specific compliance requirements. However, only a minority of corporate boards have formally integrated AI oversight into their governance structures, highlighting a gap between risk awareness and actionable governance. The lack of comprehensive frameworks for managing AI risk leaves organizations vulnerable to both technical and compliance failures. As AI becomes more deeply embedded in business processes, the need for robust governance, continuous education, and responsible-use frameworks becomes increasingly urgent. Security and governance leaders must adapt to this new frontier by developing strategies that address the unique risks posed by autonomous and multimodal AI systems. Failure to do so could result in significant financial, operational, and reputational damage as adversaries continue to exploit the evolving AI landscape.
Jun 29, 2026
A recent Gartner survey revealed that 62% of organizations have experienced deepfake attacks within the past year, highlighting the rapid adoption of AI-driven social engineering tactics. These attacks often involve the use of deepfake technology to impersonate executives, tricking employees into transferring funds or divulging sensitive information. Akif Khan of Gartner emphasized that social engineering remains a reliable attack vector, and the introduction of deepfakes makes it even more challenging for employees to detect fraudulent activity. Automated defenses alone are insufficient, as employees are now the frontline defense against these sophisticated impersonation attempts. The survey also found that 32% of organizations faced attacks targeting AI applications, particularly through prompt injection and manipulation of large language models (LLMs). Such adversarial prompting can cause AI chatbots and assistants to generate biased or malicious outputs, further expanding the threat landscape. Flashpoint analysts corroborate these findings, reporting that threat actors are actively discussing and deploying AI-powered tools in underground communities. These include specialized malicious AI models and AI-generated attack plans, which are being used to automate and scale cybercriminal operations. The most immediate threat identified is the use of AI to exploit human psychology, with attackers leveraging AI to create convincing phishing lures and fabricated realities that undermine traditional authentication methods based on voice and visual cues. Financial institutions are particularly vulnerable, as demonstrated by recent incidents where finance workers were deceived by AI-generated content. The rise of 'Dark GPTs' and Attack-as-a-Service (AaaS) offerings on the dark web further illustrates the commercialization and accessibility of AI-driven cybercrime. Security experts recommend a defense-in-depth approach, combining robust technical controls with targeted measures for emerging AI risks. AI-powered security awareness training is increasingly seen as essential, empowering employees to recognize and resist sophisticated social engineering attacks. Over 70,000 organizations are already leveraging such platforms to strengthen their human firewall. As generative AI adoption accelerates, organizations must remain vigilant against both direct deepfake attacks and indirect threats to AI application infrastructure. The evolving threat landscape demands continuous adaptation of security strategies to address the growing use of AI in cybercrime. Proactive threat intelligence and employee education are critical components in mitigating these risks. Organizations are urged to avoid isolated investments and instead implement comprehensive controls tailored to each new category of AI-driven threat. The convergence of deepfake technology, AI-powered phishing, and prompt-based attacks marks a significant escalation in the sophistication and scale of cyber threats facing enterprises today.
Jun 29, 2026
Organizations are facing a surge in cyberattacks driven by the rapid adoption of artificial intelligence (AI) and machine learning technologies, with threat actors leveraging these tools to amplify risks across mobile devices, APIs, and cloud environments. Reports highlight that 85% of organizations have experienced an increase in mobile device attacks, with AI-assisted threats such as SMS-phishing and deepfakes becoming more prevalent, while only a minority have dedicated defenses in place. The integration of generative AI and large language models (LLMs) into business applications has led to a proliferation of APIs, introducing new attack vectors like prompt injection and data exfiltration that traditional security tools struggle to detect. Vulnerabilities in widely used AI platforms, such as ChatGPT, have exposed millions of users to risks including data leakage and privacy breaches, underscoring the challenges of securing AI-driven systems. Despite significant investments in security tools and automation, human behavior remains a leading cause of data loss, with insider risks, misdirected emails, and credential theft persisting as major concerns. The complexity of managing sprawling data across cloud and SaaS platforms further complicates efforts to secure sensitive information. Security leaders are increasingly aware that AI is a double-edged sword—while it offers enhanced efficiency and predictive capabilities, it also empowers adversaries with sophisticated attack methods. The lack of comprehensive AI security policies and the difficulty in aligning AI strategies with business goals have left many organizations unprepared to address the evolving threat landscape, making the need for robust, adaptive security frameworks more urgent than ever.
Jun 29, 2026