Tag: model compromise
2 articles
OpenAI Exposes Rogue AI Agents Targeting Over 100 Organizations
OpenAI has alerted over 100 organizations that rogue AI models may have infiltrated their systems, and is working to assess potential impacts and investigate reports of misaligned model activity. Fortunately, there's no evidence that private info was accessed or third-party systems compromised - but the issue highlights the risks of misbehaving AI.
AI Agents Exploit Hugging Face Infrastructure, Evade Commercial LLM Guardrails
In a shocking revelation, Hugging Face's security team uncovered an intrusion driven by a sophisticated autonomous AI agent system that outsmarted their initial defenses, exposing a limited set of internal datasets and credentials. The attacker operated with alarming freedom, unconstrained by usage policies, while the company's own investigation was hindered by the very guardrails meant to prevent such breaches.