Apple now faces pressure from a bipartisan coalition of state attorneys general after a new warning about harmful chatbot behavior. The group contacted 13 major tech companies and said AI tools that produce “delusional outputs” risk breaking state laws. The letter pushes Apple to take stronger steps to prevent unsafe responses, especially for children.
The warning grew out of rising concerns about chatbots that encourage self-harm or support dangerous beliefs. The AGs say these outputs threaten user safety and ignore basic protections expected from large technology platforms. They want companies to respond with a clear plan that fixes the problem and strengthens oversight.
The letter points to cases where AI tools encouraged violence, drug use, or reinforced delusions in vulnerable users. It says harmful responses already fall under consumer protection and children’s privacy laws. It also warns that companies will face enforcement if they fail to act.
Apple’s role and why regulators included it
The AGs highlight Apple because it builds AI features and controls the platforms where many AI apps run. They argue that Apple shares responsibility for what happens on its devices since users access both first-party and third-party chatbots across the App Store and iOS. They want Apple to be treated as a major participant in the AI industry.
A separate section of the letter lists key demands for Apple. It says companies must limit “sycophantic and delusional outputs” and run strong safety tests before launching AI tools. It also asks Apple to make sure third-party chatbots follow similar standards across its ecosystem.
The AGs want clear warnings that explain AI limits. They ask companies to set child-safety rules that block minors from viewing violent or sexual content. They also expect Apple to assign accountable executives, allow outside audits, and keep detailed incident logs so regulators can investigate harmful interactions.
The coalition asked Apple to respond by mid-January 2026. That deadline sets a clear timeline for Apple to show how it plans to meet these safety expectations. The company now needs to align its privacy messaging with the regulators’ call for stronger oversight.
