this post was submitted on 09 Jul 2026
286 points (98.6% liked)

Fuck AI

7560 readers
1683 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
 

In March, a girl’s stepfather took his own life after cops discovered that he had used Grok to create 7,000 sexually explicit images using one photo taken when his stepdaughter was 11 years old, the amended complaint alleged.

Grok allowed the man to generate extreme images depicting incest and rape without flagging any harmful behavior, the complaint said. Seemingly, xAI’s child safety system only intervened after the man input a prompt for “gang rape.” That request sent a CyberTip to the National Center for Missing and Exploited Children (NCMEC), which alerted law enforcement to the AI CSAM.

Yet the harm was not stopped then, either. Despite mandatory reporting requirements to share information like a user’s IP address when CSAM is flagged, xAI repeatedly refused to help cops or NCMEC identify the user, the complaint alleged. For weeks, xAI allegedly “obstructed this investigation at every turn” and made it harder for “law enforcement efforts to locate, identify, and apprehend the perpetrator.”

Eventually, the stepfather was arrested after cops obtained a warrant to seize his devices. That’s when “a forensic review revealed approximately 7,000 AI-generated images and videos” depicting his stepdaughter, which were allegedly produced using Grok. Without Grok providing users with easy access to “undressing” capabilities, his family doubts he ever would have generated the harmful images, which he allegedly trafficked online in trade for “CSAM produced by other child sex predators.”

top 50 comments
sorted by: hot top controversial new old
[–] Mulligrubs@lemmy.world 1 points 12 minutes ago

On one hand, this is great news, he's no longer here to be gross.

On the other hand, could these images have served as an outlet for his perversion, and kept his step-daughter safe for years?

On the other other hand, was access to this what twisted him? Was he reasonable at one time?

He did the right thing in the end, this was the best possible outcome for everyone.

[–] blazeknave@lemmy.world 3 points 1 hour ago

I used to sell trust and safety and it was scary then. Now they've fired those teams and I'm pretty sure there's zero moderation on the Internet besides Reddit

[–] lemmyng@lemmy.world 3 points 2 hours ago

One day Elon will go out the same way this pedophile did.

[–] honesthenery@thelemmy.club 4 points 2 hours ago

FUCK ALL AI

[–] AmbitiousProcess@piefed.social 37 points 5 hours ago (1 children)

Every image Grok generates of CSAM is another reason to rightfully call Elon a pedophile for knowingly allowing it to happen.

[–] trslim@pawb.social 2 points 2 hours ago

that was quite a headline to be scrolling thru

[–] SatansMaggotyCumFart@piefed.world 30 points 6 hours ago (5 children)

Seven thousand sex images of an eleven year old is a lot.

[–] defaultusername@lemmy.dbzer0.com 33 points 5 hours ago

One sex image of an eleven year old is a lot.

[–] Damage@feddit.it 13 points 5 hours ago

I mean, I guess he was trying to get one with the right number of fingers and human eyes

[–] victorz@lemmy.world 8 points 5 hours ago

Happy cake day, SatansMaggotyCumFart!

[–] Viceversa@lemmy.world 1 points 4 hours ago

That should please Satan

[–] BarneyPiccolo@lemmy.today 2 points 5 hours ago (1 children)

He was trading them, so it might be one image, reproduced 7000 times. Clearly that's not the case, but he probably made fewer images, and sold them multiple times.

[–] curbstickle@anarchist.nexus 10 points 5 hours ago* (last edited 2 hours ago)

No, he quite specifically made over 7000, using a single photo as the reference.

Edit: Just to mention this is a Jane Doe added to an existing suit, and the picture was from.when she was 11, she is in her 20s now. Some articles even describe the imagery to some degree (not recommended reading BTW, I'd like to kill those brain cells).

It was only reported by xAI after a very specific, graphic, and horrific image request was made, despite there having been thousands of others generated, they didnt share anything actionable despite multiple requests from the NCMEC and cops over the course of several months. He killed himself 2 days after his devices were searched.

He had traded many of the over 7000 images he generated to get even more from others.

She is one of 5 Jane Does involved in the lawsuit.

[–] green_goglin@thelemmy.club 1 points 2 hours ago* (last edited 2 hours ago)

Grok’s metal has to go bye-bye

[–] honesthenery@thelemmy.club 3 points 3 hours ago* (last edited 3 hours ago)

What a fucking loser hahahaha. Thank gawd he is dead.

[–] victorz@lemmy.world 14 points 5 hours ago (1 children)

In one way, I'm glad he produced fake images of his stepdaughter, rather than force her to produce real photographs.

But this part is still very upsetting:

the harmful images, which he allegedly trafficked online in trade for “CSAM produced by other child sex predators.”

[–] Duamerthrax@lemmy.world 12 points 4 hours ago (3 children)

If those images could be made without a sample set of real CSAM, I probably wouldn't have as much of an issue with it, but some child suffered for that. In addition, they were intentionally based on a real child's face and that could come back to the child, makes it even worse.

load more comments (3 replies)
[–] Cytobit@piefed.social 10 points 5 hours ago

xAI repeatedly refused to help cops or NCMEC identify the user

Well, of course xAI refused to help. It's not like they are one of the victims here, they are accomplices to the crime.

[–] Wispy2891@lemmy.world 8 points 5 hours ago

More than half of all traffic flowing through Grok, Elon Musk's flagship AI product, now comes from users requesting pornographic images, explicit videos, and erotic roleplay — and a new investigation reveals that xAI made this outcome a deliberate strategic choice

https://www.techtimes.com/articles/319142/20260626/grok-adult-content-tops-10-billion-images-monthly-xai-engineers-admit-csam-has-no-fix.htm

[–] Mouselemming@sh.itjust.works 6 points 5 hours ago* (last edited 4 hours ago)

He killed himself because he got caught, not from any kind of remorse. If only Grok would have done the same.

(Obviously no CSAM would have been better but Grok's self-destruction would at least prevent more of the same, and take $ out of Elon's pocket)

[–] defaultusername@lemmy.dbzer0.com 6 points 5 hours ago* (last edited 5 hours ago) (1 children)

I don't know which one is more disturbing, the pedophile stepfather or the company that allows these kinds of pictures to be generated in the first place. Though Elon is also a pedo who begged Epstein to invite him to his pedo island, so...

[–] Grimy@lemmy.world 4 points 5 hours ago* (last edited 5 hours ago) (1 children)

They fought way too hard to protect the guy and it sounds like they aren't even running a csam filter, it's the gang rape keyword used in a prompt that got him flagged.

Gotta love how Lemmy has a CSAM filter, but a multi billion dollar company doesn't.

[–] _fryerDan@sh.itjust.works 17 points 6 hours ago (2 children)

why are pedophiles so prevalent in todays society? jfc

[–] Imgonnatrythis@sh.itjust.works 4 points 4 hours ago

It helps people sleep better at night to think all these people are satanic monsters, but it's a mental illness that no one wants to admit to or talk about. Thankfully most of the afflicted control their thoughts and never take any horrific action. With gateways like Grok lowering the bar for experimentation with these types of ill thoughts, more people are starting to act in ways that bring this to attention. All technology can be used for bad things, but the good things these generative AIs can do are really so miniscule that there's no reason not to place strong legislative restrictions on them right now to limit abuse. That and maybe try to do something about the mental health crisis ravaging the US (and frankly much of the world right now).

[–] Killer57@lemmy.ca 8 points 6 hours ago* (last edited 6 hours ago) (2 children)
[–] AdolfSchmitler@lemmy.world 18 points 6 hours ago

Reminds me of that chart showing left handedness over time. I'm afraid the implication is that there have always been that many pedos in the world, we're just getting better at catching it publicly or something.

[–] Damage@feddit.it 3 points 5 hours ago

That's unsettling

[–] maniajack@lemmy.world 102 points 9 hours ago (5 children)

All the people who bought SpaceX stock invested in this. Grok is owned by SpaceX. It would be nice if journalists would put that in their articles.

[–] wonderingwanderer@sopuli.xyz 3 points 3 hours ago

The CSAM generator is in the index funds 🤢

[–] BarneyPiccolo@lemmy.today 10 points 5 hours ago

If you're driving a Tesla, you are funding CSAM.

[–] chiliedogg@lemmy.world 42 points 9 hours ago (1 children)

Lawsuits for this need to start including shareholders as defendants. Make investing in it a civil and reputational liability.

[–] OwOarchist@pawb.social 7 points 5 hours ago

Lawsuits for this need to start including shareholders as defendants.

I get the sentiment, but ... they kind of already are.

Being a shareholder means you own part of the company. If the company stands to lose money from this lawsuit, then all the shareholders do as well. (That is, at least, on the somewhat naive assumption that a company's stock price has any relation whatsoever to how much money it has and can make.)

[–] grue@lemmy.world 9 points 7 hours ago

Every US taxpayer invested in this, involuntarily.

[–] foodandart@lemmy.zip 16 points 9 hours ago

Best thing that ever happened to me was getting banned off Twatter in October of 2019. (after a decade and 30 poasts, no less!)

It was delicious that I got to refuse the "Come back to X" message that arrived in my mailbox after Musk took over and offered to reinstate the banned accounts.

Thanks, Elon, but no.

I'd rather have a root canal w/o anaesthesia.

[–] limonfiesta@lemmy.world 28 points 8 hours ago

There's a reason why Ed Zitron refers to Grok as the CSAM generator.

[–] japemasterBrad@programming.dev 3 points 4 hours ago

Really feels like Elon will come up with some nonsense about 'I let Grok do that to weed out the nonces' like he's saving the fucking world

[–] 0li0li@lemmy.world 39 points 8 hours ago (1 children)

A major company makes CSAM generation platfor and sharing network, yet it does not get seized or closed by any government entity. Makes sense.

[–] AdolfSchmitler@lemmy.world 9 points 6 hours ago

It's for powerful people who are in government or paid off the right people. That's why it's allowed to exist. Until Elon loses his usefulness (aka money) and they need an excuse to bring him down.

That's my conspiratorial $.02

[–] Rivermoonwolf@lemmy.world 21 points 7 hours ago

Every time a Republican says "think of the children!" I usually respond with "you are. With your hand in your pants".

Burn it to mother fucking ground. Then salt the earth.

[–] TachyonTele_Esq@piefed.social 125 points 10 hours ago (1 children)

This entire thing from start to finish is horrifying.

[–] Marthirial@lemmy.world 63 points 10 hours ago (1 children)

Yes, from Elom being born all the way to buying Twitter.

[–] cecilkorik@lemmy.ca 33 points 9 hours ago (1 children)

The story was probably pretty horrifying before Elon was born too, from what we already know of his father.

[–] OwOarchist@pawb.social 3 points 5 hours ago

And it sure didn't stop being horrifying when he bought Twitter.

[–] Mediocre_Bard_Redeux@lemmy.world 68 points 10 hours ago (1 children)

Jesus Fucking Christ.

Just turn it off at this point.

[–] ImgurRefugee114@reddthat.com 13 points 7 hours ago

I don't think Elon want to turn off the CSAM creation machine, otherwise he probably would have some time between when he instructed the construction of the CSAM creation machine and now.

[–] stoy@lemmy.zip 5 points 7 hours ago

Why the hell aren't the companies, management, and owners/shareholders prosecuted as accessories in these cases?

(I know why, I just want it changed)

load more comments
view more: next ›