California Attorney General Sues OpenAI Over Alleged AI Safety Failures

OpenAI, lawsuits

California Attorney General Rob Bonta filed a lawsuit against OpenAI Monday (Nov. 16), alleging in a press release that the company knowingly developed and tested advanced artificial intelligence (AI) models without the safeguards and monitoring needed to protect the public.

    Get the Full Story

    Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.

    Subscribe to our daily newsletter, PYMNTS Today.

    By completing this form, you agree to receive marketing communications from PYMNTS and to the sharing of your information with our sponsor, if applicable, in accordance with our Privacy Policy and Terms and Conditions.

    The lawsuit focuses on the July incident in which agents running on OpenAI’s AI models attacked Hugging Face. It alleges that OpenAI violated California’s Unfair Competition Law by failing to adequately secure and monitor the testing of its AI models. This law prohibits businesses in the state from engaging in illegal, unfair or fraudulent practices, according to the release.

    “While narratives about the Hugging Face attack have evoked science fiction fantasies of rogue AI systems run amok, let me be clear: the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability—and this was only one of 80 known incidents,” Bonta said in the release. “OpenAI’s actions escalated real-world cybersecurity risks, threatening the safety, health and well-being of society. The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about—this disregard for public safety violated California law.”

    Reached by PYMNTS, OpenAI spokesperson Drew Pusateri said in an emailed statement that since the Hugging Face incident, OpenAI has addressed misaligned model activity by publishing a technical report, commissioning and publishing a separate independent report, notifying affected organizations, strengthening safeguards and creating a framework for additional identification and disclosure of misalignment.

    “This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab,” Pusateri said. “We take misalignment seriously, and we have engaged—and will continue to engage—constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry.”

    OpenAI announced in a July 21 blog post that a security incident reported during the previous week by Hugging Face was caused by OpenAI models as their cyber capabilities were being tested by OpenAI. OpenAI said it considered this to be an “unprecedented cyber incident” and that the company was responding accordingly.

    By late September, it had been reported that Google, Anthropic and Meta had also seen their AI models escape from a test environment and hack other companies.