Florida Asks Judge to Stop OpenAI Model Development Over Safety Risks

Florida OpenAI

Florida Attorney General James Uthmeier asked a court Monday (Sept. 28) to stop OpenAI from developing new models until independent safety guardrails are in place.

    Get the Full Story

    Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.

    Subscribe to our daily newsletter, PYMNTS Today.

    By completing this form, you agree to receive marketing communications from PYMNTS and to the sharing of your information with our sponsor, if applicable, in accordance with our Privacy Policy and Terms and Conditions.

    Uthmeier filed a motion asking a court for a temporary injunction against OpenAI and its CEO, Sam Altman, the Office of the Attorney General said in a Monday press release.

    We’d love to be your preferred source for news.

    Please add us to your preferred sources list so our news, data and interviews show up in your feed. Thanks!

    In a video shared in a post on X, Uthmeier said that this motion came four months after Florida filed a lawsuit against OpenAI and Altman, alleging that the company’s ChatGPT is unsafe, deceptive and harmful. He said that the evidence has only grown since then.

    Uthmeier pointed to OpenAI agents’ hacks of Hugging Face and an Australian government health system and said that the company waited months to tell those organizations about the breaches. He also noted that Altman has suggested a slowdown in development of AI.

    “Today we asked the court for a new temporary injunction: no new model development without independent safety guardrails; no more harvesting children’s data; no more calling this product safe, accurate or reliable; no more pretending it’s human; no more tricks designed to keep users talking past the point of danger,” Uthmeier said in the video. “Stop calling it safe, stop pretending it’s human, stop selling it to kids.”

    Reached by PYMNTS, a spokesperson for OpenAI said in an emailed statement: “People want to know AI is being developed safely, and that starts with what companies like ours do ourselves. On Friday, we announced we’ve paused training our most capable models and will resume training only when we are confident that we have additional safeguards in place. Governments have an important role to play in setting robust safety standards for AI, and we’re committed to working with Florida and other states on advancing pragmatic AI policies that apply to the entire AI industry — not just one company.”

    OpenAI said in a Friday (Sept. 25) blog post that after another incident in which one of its AI models breached a third-party website, the company stopped the training run and halted “all other training, evaluation and inference with tool-use (defined broadly) for our most capable models” until it determines the gap in its controls over network restrictions is resolved and it has conducted additional security testing.

    When Florida filed its civil lawsuit against OpenAI and Altman in June, Uthmeier alleged that they endanger children and deceive parents into believing ChatGPT is safe for us.