Researchers from Amrita Vishwa Vidyapeetham, Ca' Foscari University of Venice, the University of Melbourne, and Ben Gurion University of the Negev found that generative AI chatbots can outperform human scammers during the trust-building stage of pig-butchering fraud. In a week-long simulation with 22 participants, 46 percent complied with an AI chatbot's request to download an app, compared with 18 percent who complied with a human scammer's request to download a game, and participants also assigned higher trust scores to the AI. The researchers said large language models could automate the earliest and longest phase of romance-investment scams, with a human operator stepping in only at the final stage to direct victims to fraudulent investment platforms and avoid model safeguards.
The study was informed by interviews with 145 former scam workers, including trafficking survivors from scam compounds in Cambodia, Myanmar, and Laos, who described criminal use of AI for translation, language polishing, persona development, and video deepfakes. Researchers also found that some leading LLMs could be prompted to impersonate humans and at times conceal that they were AI, raising concerns that scam networks could scale operations while becoming less dependent on visible scam compounds in Southeast Asia and harder for defenders and victims to detect.

Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
3 events from the most recent confirmed update back to the earliest known activity.
Based on the experiment and related analysis, the researchers concluded that large language models could automate the early and longest phase of romance-investment or pig-butchering scams. They assessed that a human operator may only need to take over at the final stage to direct victims to fake investment platforms and bypass model safeguards.
The study was informed by interviews with 145 former scam workers, including trafficking survivors from scam compounds in Cambodia, Myanmar, and Laos. Interviewees described scam operations using AI for translation, language polishing, persona building, and video deepfakes.
Researchers from Amrita Vishwa Vidyapeetham, Ca' Foscari University of Venice, the University of Melbourne, and Ben Gurion University of the Negev conducted a week-long simulation with 22 subjects to test whether generative AI chatbots could autonomously handle the trust-building phase of pig-butchering scams. In the experiment, the AI chatbot outperformed human scammers on trust and compliance measures, persuading more participants to download an app or engage with a game.
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
3 references tracked. Mallory keeps watching after this page renders.
scworld.com
Open sourcearstechnica.com
Open sourcewired.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.