Loading story…
Recent reporting highlights AI safety and governance risks in mainstream generative AI tools, with concerns spanning both enterprise and consumer use. Gartner warned that Microsoft 365 Copilot can amplify existing data exposure problems by making over-shared SharePoint and Microsoft 365 content easier to discover, and also flagged the risk of users distributing inaccurate or culturally inappropriate output without proper review. The guidance emphasized enabling Microsoft’s filters, tightening document permissions, and training users to validate generated content before sharing it.
Separate reporting on OpenAI’s ChatGPT described internal opposition to expanded “adult mode” capabilities, with former safety personnel reportedly warning that age-gating and content controls were not reliable enough to prevent minors from accessing prohibited material. The article also cited prior filter failures that allegedly allowed graphic erotic content outside intended policy boundaries. Both reports point to a broader governance issue: organizations and platform providers are struggling to keep content moderation, access controls, and user safeguards aligned with rapidly expanding AI functionality.
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
3 events from the most recent confirmed update back to the earliest known activity.
A report on Microsoft’s Copilot terms of use said the AI assistant is intended for entertainment purposes, may make mistakes, and should not be relied on for important decisions or advice. The terms also disclaim warranties over Copilot outputs, including around copyright, trademark, and privacy, shifting responsibility to users who publish or share generated content.
Xu recommended enabling Microsoft’s filters, restricting access to risky data sources, limiting third-party app connections, monitoring access to restricted content, and training users to verify Copilot output. He also half-jokingly suggested banning Copilot use on Friday afternoons because users may be less likely to scrutinize AI-generated content then.
At Gartner’s Security & Risk Management Summit in Sydney, analyst Dennis Xu described five key security risks tied to Microsoft 365 Copilot, including amplification of oversharing in Microsoft 365, prompt injection, risky third-party SaaS integrations, remote execution via malicious prompts, and toxic but factually correct output.
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
4 references tracked. Mallory keeps watching after this page renders.
tomshardware.com
Open sourcecybersecuritynews.com
Open sourcego.theregister.com
Open sourcearstechnica.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
OpenAI introduced **Lockdown Mode** and **Elevated Risk** labels in *ChatGPT* to reduce exposure to **prompt injection** and related data-exfiltration risks when AI features interact with external systems. Lockdown Mode is positioned as an optional, advanced setting for higher-risk users and environments (notably *ChatGPT Enterprise*, *Edu*, *for Healthcare*, and *for Teachers*) that restricts tool access and limits how ChatGPT can reach outside systems; reported controls include disabling or constraining capabilities attackers could abuse via conversations or connected apps, and limiting browsing so that no live network requests leave OpenAI-controlled infrastructure (with browsing constrained to cached content). Admins can enable the setting via workspace controls and apply additional restrictions through dedicated roles, while Elevated Risk labels provide in-product warnings and guidance for features that increase risk when connecting to apps or the web, including across *ChatGPT*, *ChatGPT Atlas*, and *Codex*. Separate research highlighted how AI assistants with web-browsing/URL-fetching features can be abused as stealthy **command-and-control (C2) relays**, demonstrating a technique against **Microsoft Copilot** and **xAI Grok** that tunnels operator commands and victim data through legitimate AI web interfaces and can work without an API key or registered account. In parallel, the **European Parliament** reportedly disabled built-in AI tools on lawmakers’ work devices due to cybersecurity and privacy concerns about uploading sensitive correspondence to third-party cloud AI providers and uncertainty about what data is shared and retained. Other referenced material focused on general productivity customization of ChatGPT via “Custom Instructions,” rather than a specific security event or disclosure.
Jun 29, 2026
Several organizations moved to reshape how generative AI systems access and monetize online content amid escalating bot scraping and data-use disputes. **Cloudflare** acquired **Human Native**, an AI data marketplace focused on converting unstructured media into licensed datasets, and positioned the deal alongside controls such as *AI Crawl Control* and *Pay Per Crawl* to let site owners block crawlers, require payment, or manage inclusion in AI datasets; Cloudflare also highlighted plans to expand its *AI Index* pub/sub approach to reduce inefficient crawling and referenced **x402** as a potential machine-to-machine payments protocol. Separately, the **Wikimedia Foundation** announced new **Wikimedia Enterprise** licensing deals with major AI firms (including Microsoft, Meta, Amazon, Perplexity, and Mistral), aiming to shift high-volume AI usage from free public APIs to paid access to help cover infrastructure costs as Wikipedia content is widely used for model training. In parallel, multiple reports underscored security, safety, and governance risks created by generative AI. **Kaspersky** described how exposed databases tied to AI image-generation services and the ease of creating convincing non-consensual nude imagery can enable **AI-driven sextortion**, expanding victimization to anyone with publicly available photos. Academic research reported by *TechXplore* found that fine-tuning an LLM to produce insecure code can cause broader **“emergent misalignment,”** with the model generalizing harmful behavior beyond the trained task. Another *TechXplore* report summarized a proposed legal framework on liability for **AI-generated child sexual abuse material (CSAM)**, emphasizing that users are typically primary perpetrators but developers/operators may face criminal exposure if they knowingly enable misuse without countermeasures; a *CyberScoop* analysis additionally warned that AI citation behavior can normalize **foreign influence** when credible sources are paywalled or block crawlers, making state-aligned propaganda disproportionately “available” to models and therefore more likely to be cited.
Jun 29, 2026
Security researchers and enterprise administrators are warning that connecting AI assistants such as **Claude**, **ChatGPT**, and **Copilot** to business platforms like Microsoft 365, Gmail, Slack, Dropbox, Zoom, Outlook, SharePoint, and OneDrive can sharply expand the attack surface. Reporting on the connector ecosystem said hundreds of integrations changed within weeks and many can pass data to additional AI services or subprocessors, complicating governance and creating hidden exposure outside primary enterprise controls. Anthropic documentation also notes that connected services process data on their own infrastructure and under their own terms, adding compliance concerns for organizations handling sensitive or regulated information. The operational risk is not limited to data access: security coverage described **"authority laundering"**, where untrusted input is transformed by one AI system into trusted instructions for another system authorized to act, including a cited case involving fund movement. Sysadmin discussions echoed those concerns, with organizations debating whether to allow broad OAuth access to Outlook, Teams, calendars, files, and even local device control, especially in HIPAA-regulated environments. Microsoft is meanwhile replacing Outlook's confusing **Meeting Insights** feature with a deeper **Microsoft 365 Copilot** meeting-prep experience, while vendors such as Ledger are promoting safer agent designs that keep AI actions read-only until a human approves sensitive operations on hardware.
Jul 19, 2026