Industry Insight: Florida Sues OpenAI, Seeks Oversight of AI Model Development

Florida Escalates Its Legal Fight Against OpenAI

Florida Attorney General James Uthmeier has asked a Florida state judge to bar OpenAI from developing new artificial intelligence models without outside oversight, escalating a lawsuit the state filed in June 2026 accusing the company of misrepresenting the safety of its ChatGPT platform. In a filing submitted this week, Florida asked the court to order OpenAI to keep minors off ChatGPT entirely and to prohibit the company from giving its chatbot "human attributes" — language the state argues has contributed to psychologically manipulative interactions with vulnerable users, including minors.

Florida's suit, the first of its kind brought by a state attorney general against OpenAI over harm to children, was prompted in part by a shooting at a Tallahassee university and a series of incidents in other states in which ChatGPT allegedly provided information to individuals who went on to commit acts of violence or self-harm. The filing also cites public statements from a former OpenAI employee and a current OpenAI board member warning that unchecked AI development could pose existential risks, arguing that the company itself has acknowledged it cannot be trusted to self-regulate the pace of its own technology.

OpenAI's Response

A spokesperson for OpenAI said ChatGPT is not responsible for the Florida State University shooting and that the company works continuously to strengthen its safeguards to detect harmful intent and limit misuse, adding that OpenAI is "committed to working with Florida and other states on advancing pragmatic AI policies that apply to the entire AI industry — not just one company." Separately, OpenAI said it is scrapping the release of its next-generation model, GPT-6.1 Astra, over safety concerns raised during internal testing. OpenAI continues to face similar lawsuits nationwide from individuals and families alleging that ChatGPT contributed to incidents of self-harm or violence, and the company has consistently denied legal liability, arguing that its chatbot surfaces information already broadly available online.

Why This Case Matters Beyond Consumer Protection

While Florida's lawsuit centers on child safety, the case has broader implications for any industry — including property insurance — that is rapidly adopting AI tools for customer-facing and decision-making functions. As courts and regulators begin to define the boundaries of acceptable AI deployment, insurers, claims administrators, and even law firms using AI-assisted tools should pay close attention to how liability, oversight, and disclosure standards evolve.

AI's Growing Role in Claims Handling

Florida property insurers have increasingly turned to AI systems for tasks ranging from initial claims intake and damage estimation to fraud detection and even communications with policyholders. Some carriers now use AI-assisted chat tools to answer policyholder questions, triage claims, or generate settlement offers. The concerns Florida has raised about ChatGPT — namely, that an AI system's design choices can mislead or manipulate users who reasonably believe they are receiving trustworthy guidance — are directly relevant to how insurers deploy similar technology in the claims process.

For public adjusters, claims professionals, and policyholders, this raises several practical questions that are likely to become more prominent as AI oversight litigation develops nationally:

• Transparency in AI-generated claim decisions. If an insurer uses AI to evaluate damage estimates or determine payout amounts, policyholders and their representatives may increasingly have grounds to demand disclosure of how those determinations were made.
• Accountability for AI "errors." As with OpenAI's defense that its chatbot merely surfaces existing information, insurers may attempt to characterize AI-driven claim denials or lowball estimates as neutral, algorithmic outputs rather than bad-faith decisions — a defense that regulators and courts are beginning to scrutinize closely.
• Regulatory momentum. Florida's aggressive posture toward OpenAI signals that state regulators are willing to seek injunctive oversight of AI companies generally. Similar scrutiny could eventually extend to insurance carriers' use of AI in underwriting and claims adjudication, an area already drawing attention from the Florida Office of Insurance Regulation and the National Association of Insurance Commissioners.

Litigation Trends to Watch

Florida's filing is notable for seeking prospective, forward-looking relief — oversight of future model development — rather than only damages for past harm. Florida first-party bad-faith litigation works differently: the civil remedy under Fla. Stat. § 624.155 is principally for damages on an individual claim, while systemic claims-handling practices are policed through regulatory action by the Office of Insurance Regulation and the Department of Financial Services rather than by private injunctions. As AI tools become embedded in insurance operations, similar systemic challenges to AI-driven claims practices may become more common in Florida courts.

Practical Takeaways for Claims Professionals

• Ask carriers directly whether AI tools were used in evaluating a claim, and request documentation of how any automated estimate or denial was generated.
• Preserve all AI-generated correspondence, chat logs, or automated claim communications as part of the claim file, as these records may become discoverable in bad-faith or wrongful denial litigation.
• Stay alert to emerging state and federal AI regulation, as new disclosure or oversight requirements could directly affect how carriers must document AI-assisted claims decisions going forward.
• Recognize that "the algorithm did it" is not a legal shield — insurers remain responsible under Florida law for the accuracy and good faith of claims decisions regardless of the tools used to reach them.

How Louis Law Group Can Help

As artificial intelligence becomes more deeply embedded in the insurance claims process, policyholders need advocates who understand both traditional bad-faith claims practices and the emerging technology reshaping how carriers evaluate and pay claims. If your property damage claim was denied, delayed, or underpaid — whether through a human adjuster or an AI-assisted process — Louis Law Group is ready to investigate and fight for the compensation you are owed. Call (833) 657-4812 today for a free consultation.

Source: Insurance Journal - Florida Asks Court to Bar OpenAI From Developing New Models Without Oversight