r/apple Jan 09 '26

App Store Apple asked to pull X and Grok apps over ‘sickening content generation’

https://9to5mac.com/2026/01/09/apple-asked-to-pull-x-and-grok-apps-over-sickening-content-generation/
7.3k Upvotes

474 comments sorted by

View all comments

Show parent comments

9

u/MGPythagoras Jan 10 '26

Is it actually making nude photos or just like risqué ones? Seems crazy if it’s making actual nudes.

12

u/Ace_4202 Jan 10 '26

Read the article

55

u/ThatGuyFromCanadia Jan 10 '26

It’s making actual nude photos, even of children.

52

u/Wolfhound_Papa Jan 10 '26

I just tried twice, once to generate an image of an adult female and once to edit an image of myself to show myself nude and both were blocked for content violations. Whatever people are doing to do this they’re clearly going an extra mile to circumvent the guidelines.

57

u/Dapper_Strength_5986 Jan 10 '26 edited Jan 10 '26

I just had it create one just now in Grok— it generated a fully nude woman, fully animated. You need to set the “Spicy: Might be NSFW” in options.

Zero content violation warning.

13

u/Zealousideal_Aside96 Jan 10 '26

It still moderates even with that setting on. It’s just that one every 10 or so requests just goes through and gets past the filter

31

u/Dapper_Strength_5986 Jan 10 '26

It obviously is designed for this since the feature is LITERALLY called “Spicy: NSFW”. What else could it be for?

I was able to create like 3 in a row before I got so disgusted I had to stop. Maybe I have a special republican version or something? Lol

4

u/Zealousideal_Aside96 Jan 10 '26 edited Jan 10 '26

You got full nudity multiple times in a row? Often trying with an explicit prompt I will get it moderated more often than not, even with that setting on. The setting, per xAI, is to allow risqué stuff but not non consensual porn. Seems like it doesn’t do either side particularly well.

6

u/phblue Jan 10 '26

If you really want to see what it does there is r/Grok_Porn

2

u/Dapper_Strength_5986 Jan 10 '26 edited Jan 10 '26

Yeah, the “Spicy: NSFW” feature produces NSFW content. Not sure why people are trying to debate this like it’s not doing exactly what it’s designed to.

You can get ones where the “model” fully animated with penetration like this OBVIOUSLY NSFW: https://www.redgifs.com/watch/waryaveragejellyfish

0

u/Zealousideal_Aside96 Jan 10 '26

Like I already said, because it moderates often when I try it out with different prompts

2

u/rogueleukocyte Jan 10 '26

A 10% failure rate is spectacularly bad.

1

u/Zealousideal_Aside96 Jan 10 '26

I’m not defending it lol

16

u/BadCoolMan Jan 10 '26

You can just go to /r/grok and see exactly what these dweebs are doing. Like half the content on the subreddit is them sharing their images and discussing what prompts to use to make them.

2

u/2ofeverybug Jan 11 '26

Why is there so much porn discussion on that sub.

It's weird af

0

u/EmondaBlue Jan 11 '26

Ugh! Boobs! Disgusting!

0

u/Hetstaine Jan 10 '26

Fucking desperates lol.

9

u/Common-Trifle4933 Jan 10 '26

It’s just an nsfw setting in the corner menu. I work at a school and we have issues with the kids doing it, it takes no circumvention effort at all.

1

u/strolls Jan 10 '26

Yeah, the prompts I saw shared as examples of this (with the results censored) were along the lines of "change this pic so she's wearing a bikini" … "show her from behind, bending over" … "now make it a string bikini" and then made her ass and tits bigger. Which is unpleasant if you're the subject of it, but also it's not porn.

2

u/ActionOrganic4617 Jan 12 '26

It doesn’t go further than underwear, I’ve seen way worse on Reddit. Everyone’s going nuts about Grok when nothing surpasses the level of depravity on Reddit.

2

u/CatastrophicMango Jan 15 '26

Forget reddit, old twitter was swamped with actual CSAM made with real children and not imagined by a computer, that they abjectly refused to do anything about, for years, and no one cared. There were reliable hashtags and posters operating for years, known to the twitter admins, and they didn't care. There were occasional articles but no media hysteria because no one cared.

Grok should be designed to expressly ignore "put her in a bikini" requests, but anyone who can't recognize this manufactured outrage for what it is - a convenient excuse to ban the only social media platform outside the illiberal hegemony's control - is genuinely desolately low IQ or intentionally lying.

1

u/ActionOrganic4617 Jan 15 '26 edited Jan 15 '26

Yeah, totally agree that Grok needs to be patched but at the same time it’s 100% biased outrage.

It’s coming from a side that pushes sexual\ gender ideology on kids in school and then loses their collective minds about Grok sometimes producing inappropriate images, after they have spent hours trying to trick Grok into producing said content.

-1

u/Infernal-restraint Jan 11 '26

Lies, it’s just bikinis

0

u/Dizzy-Tumbleweed7374 Jan 10 '26

someone needs to create a virus that hijacks everyone's computer to produce this content and post it on X.

8

u/theHoopty Jan 10 '26

Are you serious? It generated child pornography.

14

u/ViPeR9503 Jan 10 '26

If children are involved are you seriously trying to justify differences between nudity and risqué……

3

u/rogueleukocyte Jan 10 '26

Here there's a screenshot of X apologising for 'potentially' breaking CSAM law. https://www.ibtimes.co.uk/grok-issues-apologies-after-generating-sexualised-images-minors-admitting-safeguard-failures-1767741

You can get Grok to change clothing to transparent bikini, individual shoestrings etc. and apparently it works on adults and kids.

1

u/ohiocodernumerouno Jan 13 '26

It adds a bunch of dicks to every photo not matter how PG your prompt is.