Loading story…
Automated bot farms have become a central tool in modern information warfare, leveraging artificial intelligence to manipulate public opinion, influence elections, and erode trust in institutions. According to Thales, automated bot traffic accounted for 51% of all web traffic in 2024, marking the first time in a decade that bots have surpassed human activity online. These bots, often state-sponsored by countries such as Russia, China, and Iran, use sophisticated techniques to mimic human behavior, making them increasingly difficult to detect. AI-driven bots can generate content at a scale and speed unattainable by humans, flooding online platforms with misinformation and pushing authentic conversations to the margins. By creating the illusion of consensus, these bots can make fringe viewpoints appear mainstream, amplifying divisive narratives and undermining democratic debate. The phenomenon known as the 'liars dividend' emerges as people begin to distrust all online content, knowing that fakes and bots are pervasive. In one notable case, 45 bot-like accounts on X posted over 440,000 times before a UK election, reaching more than 3 billion views, and continued their activity after the vote. Experiments have shown that even when users are asked to identify bots, they are often unsuccessful, with a 58% error rate observed in political discussions on Mastodon. The evolution of bots is further accelerated by AI, which enables them to mimic human actions such as typing, scrolling, and pausing, making detection even more challenging for security teams. Generative AI tools have lowered the barrier to entry for attackers, allowing even those with limited technical skills to launch large-scale credential stuffing campaigns, scrape websites, or orchestrate scams. The scale and sophistication of these operations mean that both brute-force and stealth attacks are on the rise, with bots capable of blending seamlessly into normal traffic. The impact of these campaigns is global, with Russia leading efforts to weaken democratic processes in the US and Europe through targeted disinformation. As bots become more prevalent and harder to distinguish from real users, the challenge for cybersecurity professionals intensifies, requiring new strategies and technologies to detect and mitigate automated threats. The growing reliance on AI in bot operations signals a paradigm shift in the threat landscape, demanding heightened vigilance and adaptive defenses from organizations and governments alike. The erosion of trust in digital information poses a significant risk to democratic institutions and public discourse, making the fight against AI-driven disinformation a top priority for the cybersecurity community. The combination of technical sophistication, global reach, and psychological impact underscores the urgent need for comprehensive countermeasures. As the arms race between bot operators and defenders escalates, the future of online trust and security hangs in the balance.
Track how attackers are adapting to this technology.
1 event from the most recent confirmed update back to the earliest known activity.
Initial story creation
Follow how adversaries are adapting to this technology, and where it touches your stack today.
2 references tracked. Mallory keeps watching after this page renders.
Map indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Cybercriminals are increasingly leveraging advanced AI technologies, including large language models (LLMs) and agentic AI, to automate and scale online fraud, abuse, and credential theft campaigns. These AI-driven attacks enable adversaries to craft convincing phishing emails, create fake websites, and even execute deepfake voice or video calls, making it more difficult for organizations to detect and defend against malicious activity. The rise of agentic AI, which can autonomously gather inputs, evaluate options, and take actions such as infiltrating networks and stealing credentials, marks a significant escalation in attacker sophistication and persistence. Recent research highlights a 300% increase in AI-powered bot traffic, complicating the application and API threat landscape and lowering the barrier to entry for cybercriminals through fraud-as-a-service (FaaS) offerings. These developments have led to a surge in digital fraud and abuse, impacting key industries and regions globally. Organizations are advised to adopt AI-driven defenses and maintain regulatory compliance to counteract the growing threat posed by malicious AI bots and automated credential theft campaigns.
Jun 29, 2026
A recent Gartner survey revealed that 62% of organizations have experienced deepfake attacks within the past year, highlighting the rapid adoption of AI-driven social engineering tactics. These attacks often involve the use of deepfake technology to impersonate executives, tricking employees into transferring funds or divulging sensitive information. Akif Khan of Gartner emphasized that social engineering remains a reliable attack vector, and the introduction of deepfakes makes it even more challenging for employees to detect fraudulent activity. Automated defenses alone are insufficient, as employees are now the frontline defense against these sophisticated impersonation attempts. The survey also found that 32% of organizations faced attacks targeting AI applications, particularly through prompt injection and manipulation of large language models (LLMs). Such adversarial prompting can cause AI chatbots and assistants to generate biased or malicious outputs, further expanding the threat landscape. Flashpoint analysts corroborate these findings, reporting that threat actors are actively discussing and deploying AI-powered tools in underground communities. These include specialized malicious AI models and AI-generated attack plans, which are being used to automate and scale cybercriminal operations. The most immediate threat identified is the use of AI to exploit human psychology, with attackers leveraging AI to create convincing phishing lures and fabricated realities that undermine traditional authentication methods based on voice and visual cues. Financial institutions are particularly vulnerable, as demonstrated by recent incidents where finance workers were deceived by AI-generated content. The rise of 'Dark GPTs' and Attack-as-a-Service (AaaS) offerings on the dark web further illustrates the commercialization and accessibility of AI-driven cybercrime. Security experts recommend a defense-in-depth approach, combining robust technical controls with targeted measures for emerging AI risks. AI-powered security awareness training is increasingly seen as essential, empowering employees to recognize and resist sophisticated social engineering attacks. Over 70,000 organizations are already leveraging such platforms to strengthen their human firewall. As generative AI adoption accelerates, organizations must remain vigilant against both direct deepfake attacks and indirect threats to AI application infrastructure. The evolving threat landscape demands continuous adaptation of security strategies to address the growing use of AI in cybercrime. Proactive threat intelligence and employee education are critical components in mitigating these risks. Organizations are urged to avoid isolated investments and instead implement comprehensive controls tailored to each new category of AI-driven threat. The convergence of deepfake technology, AI-powered phishing, and prompt-based attacks marks a significant escalation in the sophistication and scale of cyber threats facing enterprises today.
Jun 29, 2026
Cybercriminals are increasingly leveraging artificial intelligence to enhance the effectiveness and scale of phishing and scam operations. Generative AI technologies now enable attackers to create highly convincing deepfakes, fabricate entire personas, and automate the setup of phishing websites and email campaigns. Romance scams, such as 'pig butchering,' have evolved from being operated by large scam farms to being powered by AI bots that can simultaneously engage with multiple victims, building emotional connections over extended periods before soliciting fraudulent investments. Catfishing has become more sophisticated, with neural networks capable of imitating a person’s appearance, voice, or writing style, making impersonation attacks more convincing and harder to detect. Attackers are also using AI development tools to craft realistic phony CAPTCHA pages, which are designed to trick users into believing they are interacting with legitimate security checks, thereby harvesting credentials or other sensitive information. A new phishing automation platform, SpamGPT, has emerged, offering a full suite of email campaign tools powered by generative AI. SpamGPT mimics professional email marketing services but is tailored for cybercrime, featuring modules for campaign management, deliverability testing, and analytics. The platform’s built-in AI assistant, KaliGPT, can generate persuasive phishing email templates, subject lines, and targeting advice, removing the need for attackers to write their own content. SpamGPT is marketed as a spam-as-a-service solution, promising guaranteed inbox delivery for major email providers by fine-tuning messages to bypass security filters. The platform also abuses trusted cloud providers like Amazon AWS and SendGrid to blend malicious emails with legitimate traffic, further evading detection. These advancements mean that phishing campaigns can now be launched at scale with minimal technical expertise, increasing the threat to both individuals and organizations. The use of AI in scams extends to social engineering, where attackers can convincingly impersonate friends, family, or colleagues, increasing the likelihood of successful attacks. Security experts warn that the rapid evolution of AI-powered phishing tools is outpacing traditional defense mechanisms, necessitating updated awareness and technical controls. Organizations are advised to educate users about the risks of AI-driven scams and to implement advanced email filtering and authentication technologies. The convergence of generative AI and cybercrime is expected to continue, with attackers constantly refining their tactics to exploit new AI capabilities. Vigilance and proactive security measures are essential to mitigate the growing threat posed by AI-enhanced phishing and scams.
Jun 29, 2026