Apple has removed an App Store app that allowed users to create AI-generated pornographic deepfakes of real people, after ads promoting the app appeared across Meta’s platforms. Meta also removed the advertising campaign after questions were raised about the content.
WIRED reports that the app, called Kromix, presented itself as an “AI image styler,” while its advertising promoted fewer restrictions and the ability to generate content involving real people. One advertisement reportedly featured an AI-generated woman closely resembling a prominent female US politician before showing sexually explicit deepfake content using the same face.
The campaign reportedly included 32 ads that Meta showed exclusively to male users. Both companies acted after WIRED contacted them, with Apple removing Kromix from the App Store and Meta taking down the advertising campaign.
Don’t miss the best of The Mac Observer
Set us as a preferred source and our Apple reporting ranks higher in your Google Search results and Discover feed — one tap, no account changes.
Apple says Kromix changed after App Store review
Apple told WIRED that Kromix appeared to have added the prohibited features after passing the company’s initial App Store review process. Apple said its rules have long prohibited apps designed to generate, distribute, or consume pornography, including apps that create fake nude images.
The company also said it works to remove apps and developer accounts that attempt to bypass its review process and policies. Apple made similar comments last month after San Francisco City Attorney David Chiu called on the company to remove eight “nudify” apps from the App Store.
WIRED also identified another app called MaskAI through a separate investigation into ads running on Meta’s platforms. The app reportedly allowed users to upload photos and place people into sexual situations through AI-powered face swapping, and Apple removed MaskAI after the publication contacted the company.
The latest removals add to ongoing concerns about how AI deepfake apps reach major app stores and advertise their services through large social platforms despite existing content policies.
Discussion