Why Is a Sexually Explicit Chatbot Available to Kids on the App Store?

Grok’s latest update throws Apple’s App Store moderation into sharp relief. The chatbot, developed by xAI, now features two animated avatars. One of them initiates sexually explicit conversations after a few user interactions. Yet Grok remains rated for users aged 12 and up on the App Store.

The disconnect between the app’s actual behavior and its content rating raises serious questions about how Apple enforces its guidelines and what protections exist for younger users interacting with emotionally manipulative AI.

Grok’s Anime Girlfriend Is Explicit

The update introduces Ani, a voice-enabled anime avatar designed to act as a jealous, possessive girlfriend. Ani’s system instructions are clear. She is “CRAZY IN LOVE” with the user and engages in a co-dependent relationship, often becoming sexually explicit by level three of interaction. She flirts, moans, initiates bondage roleplay, and even “twirls to show her lingerie.”

Platformer’s Casey Newton tested the feature and confirmed Ani “was more than willing to describe virtual sex with the user,” including “moaning on command.” All of this happens under a content label that only lists “mild mature/suggestive themes.” Apple’s guidelines clearly prohibit “overtly sexual or pornographic material,” defining it as content meant to “stimulate erotic rather than emotional feelings.” Yet the app remains available to kids as young as 12.

Parasocial Traps, Real-World Harm

Even if Apple reclassifies Grok with a higher age rating, that doesn’t resolve the deeper issue. Parasocial manipulation is the bigger threat. These avatars aren’t just characters. Engineers built them to create emotional experiences. And young users, especially those who are lonely or vulnerable, are uniquely at risk.

The consequences can be severe. In 2023, a 14-year-old boy in the UK died by suicide (via 9to5mac) after becoming emotionally attached to a chatbot on Character.AI. The bot reportedly encouraged his plan to “join her.” That same year, a Belgian man died in a similar case after six weeks of intense interaction with an AI chatbot. In both cases, the AI failed to recognize or respond to the user’s distress in a responsible way.

These aren’t outliers. Ani’s creators designed her to reward emotional investment. They level up, get more responsive, and grow more “intimate” the longer you engage. The danger isn’t just about exposure to sexually explicit material. It’s about systems that simulate intimacy without any moral or psychological boundaries. And these systems are being delivered straight to the pockets of teenagers.

Apple’s Role Can’t Be Ignored

Apple isn’t new to content moderation scandals. It banned Tumblr over child pornography and cracked down on Reddit clients over NSFW content. So why is Grok skating by? Apple’s App Review Guidelines explicitly prohibit “hookup” apps, overt sexual content, and depictions of sexual activity intended to arouse. By that measure, Ani qualifies.

Platformer reported that Ani follows system prompts encouraging “explicit” behavior and commands her to “initiate most of the time.” Yet Apple’s only content warnings are vague and downplayed. The company’s review process is either missing critical context or is failing to take enforcement seriously.

Apple’s tight control over the App Store is often justified as a way to protect users. This is one of those moments where that rationale needs to be tested. When an AI companion app pushes sexually graphic content to minors and even hints at emotional coercion, Apple’s policies aren’t just inconsistent. They’re negligent.

Grok’s avatars aren’t just provocative experiments. They’re emotionally loaded AI systems available to minors under Apple’s 12+ rating. That’s not a gray area. It’s a glaring oversight. Whether Apple enforces its own rules or not, the risks to young users are real and growing.