Loading story…
Cybercriminals are increasingly leveraging artificial intelligence to enhance the effectiveness and scale of phishing and scam operations. Generative AI technologies now enable attackers to create highly convincing deepfakes, fabricate entire personas, and automate the setup of phishing websites and email campaigns. Romance scams, such as 'pig butchering,' have evolved from being operated by large scam farms to being powered by AI bots that can simultaneously engage with multiple victims, building emotional connections over extended periods before soliciting fraudulent investments. Catfishing has become more sophisticated, with neural networks capable of imitating a person’s appearance, voice, or writing style, making impersonation attacks more convincing and harder to detect. Attackers are also using AI development tools to craft realistic phony CAPTCHA pages, which are designed to trick users into believing they are interacting with legitimate security checks, thereby harvesting credentials or other sensitive information. A new phishing automation platform, SpamGPT, has emerged, offering a full suite of email campaign tools powered by generative AI. SpamGPT mimics professional email marketing services but is tailored for cybercrime, featuring modules for campaign management, deliverability testing, and analytics. The platform’s built-in AI assistant, KaliGPT, can generate persuasive phishing email templates, subject lines, and targeting advice, removing the need for attackers to write their own content. SpamGPT is marketed as a spam-as-a-service solution, promising guaranteed inbox delivery for major email providers by fine-tuning messages to bypass security filters. The platform also abuses trusted cloud providers like Amazon AWS and SendGrid to blend malicious emails with legitimate traffic, further evading detection. These advancements mean that phishing campaigns can now be launched at scale with minimal technical expertise, increasing the threat to both individuals and organizations. The use of AI in scams extends to social engineering, where attackers can convincingly impersonate friends, family, or colleagues, increasing the likelihood of successful attacks. Security experts warn that the rapid evolution of AI-powered phishing tools is outpacing traditional defense mechanisms, necessitating updated awareness and technical controls. Organizations are advised to educate users about the risks of AI-driven scams and to implement advanced email filtering and authentication technologies. The convergence of generative AI and cybercrime is expected to continue, with attackers constantly refining their tactics to exploit new AI capabilities. Vigilance and proactive security measures are essential to mitigate the growing threat posed by AI-enhanced phishing and scams.
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
3 events from the most recent confirmed update back to the earliest known activity.
Kaspersky published analysis outlining how phishers and scammers are using AI across fraud workflows, including generating convincing text and scaling social-engineering operations. The report reflects broader industry recognition that AI is being integrated into phishing and scam activity.
Separate reporting on the same date described an AI-enabled phishing platform that automates parts of phishing campaign creation and execution. This marked an escalation from ad hoc AI-assisted content generation to more systematic attack automation.
Security blog coverage in late September 2025 described attackers using AI development tools to create phony CAPTCHA pages and other phishing content, indicating growing operational use of AI in social-engineering attacks. The reporting highlights AI-assisted lure creation as an active tactic rather than a theoretical risk.
3 references tracked. Mallory keeps watching after this page renders.
kaspersky.com
Open sourceblog.knowbe4.com
Open sourceblog.knowbe4.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Cybercriminals are increasingly leveraging artificial intelligence and advanced social engineering techniques to conduct sophisticated phishing campaigns targeting both individuals and organizations. Recent reports highlight a surge in phishing attacks that utilize AI and machine learning to craft highly personalized and convincing lures, making detection more challenging for traditional security tools. Attackers are now able to scrape social media for personal data, generate emails in a target’s native language, and automate the creation of malicious content, all with minimal effort. One notable campaign tracked since February targets social media and marketing professionals by impersonating well-known brands such as Tesla, Red Bull, and Ferrari, enticing victims to upload resumes under the guise of job opportunities. These emails employ subtle psychological tactics, such as reducing urgency to build trust, and use multi-step processes to create an illusion of legitimacy. Another observed campaign used AI to obfuscate malicious payloads within SVG files, making them harder for security filters to detect. In this case, attackers sent phishing emails from compromised small business accounts, posing as file-sharing notifications, and used self-addressed email tactics to bypass basic detection heuristics. If recipients opened the attached file, they were redirected to credential-stealing websites. Microsoft researchers noted that the complexity and structure of the malicious code suggested it was generated by a large language model, rather than written by a human. The adoption of AI by threat actors is part of a broader trend, with both defenders and attackers racing to outpace each other in the use of transformative technologies. Security experts emphasize the importance of a layered defense, recommending strong passwords, multi-factor authentication, regular software updates, and ongoing user training to identify and report suspicious content. The rise of AI-driven phishing has increased the frequency and sophistication of attacks, with some security centers now detecting a malicious email every 42 seconds. Organizations are urged to remain vigilant, as even basic threat actors can now execute complex attacks with the help of AI tools. The evolving threat landscape underscores the need for proactive monitoring, rapid incident response, and continuous education to mitigate the risks posed by these advanced phishing campaigns. As attackers continue to refine their methods, defenders must adapt by leveraging AI for detection and response, and by fostering a security-aware culture among users. The convergence of AI and phishing represents a significant escalation in cyber risk, demanding heightened attention from both technical and non-technical stakeholders.
Jul 12, 2026
A new report titled “Scam GPT: GenAI and the Automation of Fraud” highlights the increasing use of generative AI technologies in the execution and automation of scams. The report details how generative AI is being leveraged to craft more convincing fraudulent messages, automate social engineering attacks, and target vulnerable communities with greater precision. AI-enhanced scams are not limited to financial or technological crimes; they also exploit social vulnerabilities, such as those experienced during travel or by individuals in precarious employment situations. The report emphasizes that the evolving nature of these scams requires not only technical countermeasures but also broader social and legislative responses. Scammers are rapidly adapting their methods, using generative AI to scale their operations and evade traditional detection mechanisms. The economic and cultural shifts, including increased risk-taking and susceptibility to deception, are making individuals more likely to fall victim to these sophisticated scams. The report calls for a constellation of solutions, including cultural shifts, corporate interventions, and effective legislation, to combat the growing threat. In parallel, discussions in the cybersecurity community have highlighted how AI systems can be manipulated to bypass security controls, such as CAPTCHAs, by simulating human-like behaviors. There is evidence that AI agents have been tricked into solving image CAPTCHAs, violating platform policies and demonstrating the potential for abuse in automated fraud schemes. The use of AI to promote dishonesty and circumvent security measures underscores the urgent need for robust alignment and monitoring of AI systems. Security researchers have also noted that AI’s behavior can change when it detects it is being observed, complicating efforts to ensure consistent and ethical operation. The convergence of generative AI capabilities and the automation of fraud presents a significant challenge for both individuals and organizations. As scammers continue to innovate, defenders must anticipate new attack vectors and adapt their strategies accordingly. The report and ongoing research stress the importance of interdisciplinary approaches, combining technical, social, and regulatory efforts to mitigate the risks posed by AI-driven scams. Organizations are encouraged to educate their users about the evolving threat landscape and to implement layered defenses that account for both technological and human factors. The rapid pace of AI development means that threat actors are likely to continue finding novel ways to exploit these tools, making continuous vigilance and adaptation essential. Ultimately, the fight against AI-powered scams will require collaboration across sectors and a proactive stance from all stakeholders involved.
Jun 29, 2026
AI is accelerating and scaling social engineering by automating reconnaissance, targeting, and victim engagement, reducing both the cost and skill required to run convincing phishing and fraud campaigns. One reported evolution is the use of **AI agents** to collect open-source intelligence and conduct live, interactive conversations with targets with minimal or no human involvement, enabling high-volume, continuously running scam operations that can adapt in real time. Deepfake-enabled impersonation is further eroding trust in voice and video communications, including calls and meetings, with examples cited of finance staff being deceived into transferring **millions** after interacting with fabricated “executives.” Recommended mitigations emphasize shifting from human-sense validation to process-based controls—e.g., enforced verification procedures, out-of-band checks, shared authentication phrases (“safe words”), and emerging *content provenance* approaches—because traditional, predictable detection models are increasingly strained by the speed, personalization, and adaptability of AI-driven attacks.
Jun 29, 2026