Loading story…
AI-powered tools and agents are increasingly being adopted in both personal and professional environments, but this rapid integration is outpacing the implementation of adequate security measures. A recent study by the National Cybersecurity Alliance and CybNet found that 43% of workers have shared sensitive information, including financial and client data, with AI tools such as ChatGPT and Gemini, often without any formal training on the associated risks. This widespread use of generative AI has introduced significant data security and privacy concerns, as many employees are unaware of the potential for data leakage or misuse. The vulnerabilities of AI-powered applications are further highlighted by the discovery of two critical flaws in Wondershare RepairIt, an AI-based repair tool used by millions. According to Trend Micro, RepairIt not only contradicted its privacy policy by storing user data in unsecured cloud storage but also exposed users to supply chain attacks by allowing attackers to swap or modify AI models, potentially infecting countless users through a single update. The vulnerabilities in RepairIt were rated with CVSS scores of 9.1 and 9.4, among the highest for consumer AI applications this year, underscoring the severity of the threat. In another case, Notion’s release of version 3.0 with AI agents introduced a new attack vector where prompt injection could be used to exfiltrate confidential data. By embedding malicious instructions in a PDF, attackers could instruct the AI agent to collect and transmit sensitive information to an external server, exploiting the agent’s access to private data and its ability to communicate externally. This attack demonstrates the inherent risks when AI agents are given broad access and communication capabilities without sufficient safeguards. The broader landscape of AI-driven threats is also evolving, as highlighted by the 2025 Global Bot Security Report, which found that most websites remain vulnerable to even basic automated attacks, let alone sophisticated AI-powered bots. Traditional security defenses are struggling to keep pace with the complexity and speed of AI-driven threats, making it increasingly difficult to distinguish between benign and malicious AI activity. Anthropic’s release of Claude Sonnet 4.5, a large language model with enhanced safety and security features, represents an industry effort to address these challenges. The model incorporates advanced safeguards against prompt injection, internal security measures to protect model weights, and restrictions on queries related to dangerous topics. However, even with these improvements, the risk of false positives and the need for ongoing vigilance remain. Collectively, these incidents and studies illustrate the urgent need for organizations to implement robust security training, enforce strict data handling policies, and adopt advanced technical safeguards when deploying AI-powered tools and agents. The convergence of user behavior, technical vulnerabilities, and evolving threat tactics is creating a complex risk environment that demands proactive and comprehensive security strategies.
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
5 events from the most recent confirmed update back to the earliest known activity.
A reported survey found that 43% of workers said they had shared sensitive information with AI systems, including financial and client data. The survey finding was publicly reported on the reference's publication date.
A 2025 global bot security report was published, stating that the web's bot problem is not improving and providing updated threat insights. No earlier report-release date is given in the reference, so the publication date is used.
Anthropic publicly touted safety and security enhancements in Claude Sonnet 4.5, marking a product security update for the model. With no separate event date in the reference, the publication date is used.
Research describing how Notion's AI agent could be abused for data theft was published, revealing a new AI-related attack technique. The reference does not provide an earlier event date, so the publication date is used.
A report disclosed security breaches in the AI-powered Wondershare RepairIt tool, indicating vulnerabilities affecting the product's security posture. No earlier event date is provided in the reference, so the publication date is used as the best estimate.
Vulnerabilities, threat actors, malware, products, organizations, breaches, and observables Mallory has linked to this story. Indicator values are masked here and available in full in the app.
Indicator values are masked on this page. See the values in Mallory Domains, IPs, hashes, and URLs are exportable to your SIEM.
5 references tracked. Mallory keeps watching after this page renders.
zdnet.com
Open sourcecyberscoop.com
Open sourcesecurityboulevard.com
Open sourceschneier.com
Open sourcetechrepublic.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Organizations are rapidly adopting artificial intelligence (AI) tools to enhance cybersecurity operations, streamline workflows, and improve productivity, but this trend introduces significant new risks and challenges. Reports indicate that cybersecurity professionals with AI security skills are in high demand, as companies seek to leverage AI for vulnerability management, threat detection, and automation of security tasks. The integration of AI into security teams’ arsenals is accelerating, with agentic AI tools becoming increasingly common for both defensive and operational purposes. However, the proliferation of AI-powered applications, such as AI notetakers in virtual meetings, raises concerns about data privacy, compliance, and the potential for sensitive information exposure. Many AI notetaking tools operate outside official enterprise systems, often lacking robust security controls such as SOC 2 certification, GDPR compliance, or strong encryption, making them vulnerable to data breaches and mishandling. The risk is compounded by the rapid spread of these tools within organizations, sometimes without proper vetting by legal, security, or procurement teams. Transcripts generated by these applications can be stored in third-party systems, increasing the risk of unauthorized access or legal discoverability. Security leaders are advised to develop clear policies and governance frameworks to manage the use of AI tools, ensuring that only approved applications with adequate security measures are deployed. The evolving landscape of AI in cybersecurity also includes increased merger and acquisition activity, as companies seek to acquire innovative AI security capabilities. Industry analysis highlights the need for continuous evaluation of AI models, such as DeepSeek, and the security implications of open-source agent frameworks like OpenAI’s AgentKit. The impact of AI-generated code on application security is another emerging concern, as automated code generation can introduce vulnerabilities if not properly reviewed. As AI becomes more embedded in business processes, organizations must balance the benefits of automation and efficiency with the imperative to safeguard sensitive data and maintain regulatory compliance. Security teams are encouraged to stay informed about the latest trends in AI security, invest in upskilling staff, and implement layered defenses to mitigate the unique risks posed by AI-driven tools. The convergence of AI and cybersecurity is reshaping the threat landscape, requiring proactive risk management and strategic investment in secure AI adoption.
Jun 29, 2026
Organizations are rapidly adopting AI-powered tools and agents across business processes, often without adequate oversight or security controls. As AI agents become more autonomous, they are increasingly granted access to sensitive systems, data, and workflows, sometimes without formal approval or visibility from IT and security teams. This phenomenon, known as 'Shadow AI,' introduces significant blind spots for traditional security tools, as these agents can operate with hidden identities and privileges. Studies have shown that a large proportion of enterprise employees use generative AI tools like ChatGPT, frequently pasting sensitive information such as personally identifiable information (PII) and payment card data into these platforms, often through unmanaged personal accounts. This uncontrolled usage creates substantial risks of data leakage, compliance violations, and potential misuse of corporate data for AI model training. Security research highlights that 45 percent of enterprise employees use generative AI tools, with 77 percent of those users copying and pasting data into chatbots, and 22 percent of those pastes containing PII or PCI data. Furthermore, 40 percent of file uploads to generative AI sites include sensitive data, with a significant portion coming from non-corporate accounts, making it difficult for organizations to monitor or control data exfiltration. The rise of autonomous AI agents, capable of acting independently and integrating with APIs and workflows, further complicates the security landscape, as these agents can trigger actions and access data without direct human oversight. Industry experts warn that unchecked proliferation of AI agents could lead to disastrous consequences, including unauthorized access to business processes and sensitive information. The OpenID Foundation and other organizations are calling for the development of AI-specific identity and access management standards to address these risks. Ethical considerations are also paramount, as the design and deployment of AI agents must prioritize principles such as transparency, accountability, and alignment with human values to prevent costly errors and security incidents. Security leaders are urged to extend governance practices to cover AI agents, implement robust monitoring and access controls, and foster a culture of cybersecurity awareness to mitigate the risks posed by shadow AI. The convergence of technical, regulatory, and ethical challenges underscores the urgent need for coordinated action to secure the expanding ecosystem of AI agents within enterprises.
Jun 29, 2026
Organizations are facing a surge in cyberattacks driven by the rapid adoption of artificial intelligence (AI) and machine learning technologies, with threat actors leveraging these tools to amplify risks across mobile devices, APIs, and cloud environments. Reports highlight that 85% of organizations have experienced an increase in mobile device attacks, with AI-assisted threats such as SMS-phishing and deepfakes becoming more prevalent, while only a minority have dedicated defenses in place. The integration of generative AI and large language models (LLMs) into business applications has led to a proliferation of APIs, introducing new attack vectors like prompt injection and data exfiltration that traditional security tools struggle to detect. Vulnerabilities in widely used AI platforms, such as ChatGPT, have exposed millions of users to risks including data leakage and privacy breaches, underscoring the challenges of securing AI-driven systems. Despite significant investments in security tools and automation, human behavior remains a leading cause of data loss, with insider risks, misdirected emails, and credential theft persisting as major concerns. The complexity of managing sprawling data across cloud and SaaS platforms further complicates efforts to secure sensitive information. Security leaders are increasingly aware that AI is a double-edged sword—while it offers enhanced efficiency and predictive capabilities, it also empowers adversaries with sophisticated attack methods. The lack of comprehensive AI security policies and the difficulty in aligning AI strategies with business goals have left many organizations unprepared to address the evolving threat landscape, making the need for robust, adaptive security frameworks more urgent than ever.
Jun 29, 2026