this post was submitted on 09 Jul 2026
311 points (98.7% liked)

Fuck AI

7560 readers
1697 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
 

In March, a girl’s stepfather took his own life after cops discovered that he had used Grok to create 7,000 sexually explicit images using one photo taken when his stepdaughter was 11 years old, the amended complaint alleged.

Grok allowed the man to generate extreme images depicting incest and rape without flagging any harmful behavior, the complaint said. Seemingly, xAI’s child safety system only intervened after the man input a prompt for “gang rape.” That request sent a CyberTip to the National Center for Missing and Exploited Children (NCMEC), which alerted law enforcement to the AI CSAM.

Yet the harm was not stopped then, either. Despite mandatory reporting requirements to share information like a user’s IP address when CSAM is flagged, xAI repeatedly refused to help cops or NCMEC identify the user, the complaint alleged. For weeks, xAI allegedly “obstructed this investigation at every turn” and made it harder for “law enforcement efforts to locate, identify, and apprehend the perpetrator.”

Eventually, the stepfather was arrested after cops obtained a warrant to seize his devices. That’s when “a forensic review revealed approximately 7,000 AI-generated images and videos” depicting his stepdaughter, which were allegedly produced using Grok. Without Grok providing users with easy access to “undressing” capabilities, his family doubts he ever would have generated the harmful images, which he allegedly trafficked online in trade for “CSAM produced by other child sex predators.”

top 50 comments
sorted by: hot top controversial new old
[–] FE80@lemmy.world 2 points 50 minutes ago

The future is fuckin weird.

[–] Mulligrubs@lemmy.world 6 points 1 hour ago

On one hand, this is great news, he's no longer here to be gross.

On the other hand, could these images have served as an outlet for his perversion, and kept his step-daughter safe for years?

On the other other hand, was access to this what twisted him? Was he reasonable at one time?

He did the right thing in the end, this was the best possible outcome for everyone.

[–] Yerbouti@sh.itjust.works 1 points 41 minutes ago

Nothing dystopic about this headline.

[–] blazeknave@lemmy.world 5 points 2 hours ago

I used to sell trust and safety and it was scary then. Now they've fired those teams and I'm pretty sure there's zero moderation on the Internet besides Reddit

[–] lemmyng@lemmy.world 5 points 3 hours ago

One day Elon will go out the same way this pedophile did.

[–] AmbitiousProcess@piefed.social 44 points 6 hours ago (1 children)

Every image Grok generates of CSAM is another reason to rightfully call Elon a pedophile for knowingly allowing it to happen.

[–] Duamerthrax@lemmy.world 20 points 6 hours ago (1 children)
[–] FoxAlive@lemmy.zip 1 points 33 minutes ago* (last edited 17 minutes ago)

Those idiots think this should be legal, but not when the civilians do it. Tim Sweeny probably is only piping up because he insist on posting the stupidest thing his brain can come up with every day.

In no way shape or form has elon tried to dampen or stop this from happening to this day. He just made it so only paid users not in the united States can keep producing csam.

And trump wants this. This is the mysterious Ai progress we keep hearing about, next to price fixing, and survalience. States are not allowed to regulate Ai, and people will tell you that you are a dangerous person for trying to suggest that elon musk should be held accountable.

We are not all here looking for the guy who did it or confused on why this is happening. Elon musk has created a csam generator and doesnt have to stop it. Instead he just occasionally has to send one of his super fans to prison for using it the way he intended to. All to say hes doing something to stop this problem.

7k images and videos is a lot to go unnoticed. Its almost like this is allowed on their platform and encouraged. This isn't a "we can't be held accountable for what our users post" problem. This is a elon musk left a loaded gun out on a table, and he should be held liable for not putting it in a gun safe. Especially when every single other mainstream llm doesnt have this problem. Its negligence to the point of being willfully ignorant. You can't tell me they can ban you for a single comment about Israel but all the sudden their moderation isn't the greatest when 7k images and videos where being produced?

[–] honesthenery@thelemmy.club 4 points 4 hours ago

FUCK ALL AI

[–] SatansMaggotyCumFart@piefed.world 33 points 7 hours ago (6 children)

Seven thousand sex images of an eleven year old is a lot.

[–] defaultusername@lemmy.dbzer0.com 40 points 6 hours ago

One sex image of an eleven year old is a lot.

[–] Damage@feddit.it 13 points 6 hours ago

I mean, I guess he was trying to get one with the right number of fingers and human eyes

[–] victorz@lemmy.world 9 points 7 hours ago

Happy cake day, SatansMaggotyCumFart!

load more comments (3 replies)
[–] trslim@pawb.social 3 points 4 hours ago

that was quite a headline to be scrolling thru

[–] victorz@lemmy.world 17 points 7 hours ago (1 children)

In one way, I'm glad he produced fake images of his stepdaughter, rather than force her to produce real photographs.

But this part is still very upsetting:

the harmful images, which he allegedly trafficked online in trade for “CSAM produced by other child sex predators.”

[–] Duamerthrax@lemmy.world 15 points 6 hours ago (4 children)

If those images could be made without a sample set of real CSAM, I probably wouldn't have as much of an issue with it, but some child suffered for that. In addition, they were intentionally based on a real child's face and that could come back to the child, makes it even worse.

load more comments (4 replies)
[–] Cytobit@piefed.social 11 points 6 hours ago

xAI repeatedly refused to help cops or NCMEC identify the user

Well, of course xAI refused to help. It's not like they are one of the victims here, they are accomplices to the crime.

[–] Wispy2891@lemmy.world 10 points 6 hours ago

More than half of all traffic flowing through Grok, Elon Musk's flagship AI product, now comes from users requesting pornographic images, explicit videos, and erotic roleplay — and a new investigation reveals that xAI made this outcome a deliberate strategic choice

https://www.techtimes.com/articles/319142/20260626/grok-adult-content-tops-10-billion-images-monthly-xai-engineers-admit-csam-has-no-fix.htm

[–] Mouselemming@sh.itjust.works 7 points 6 hours ago* (last edited 6 hours ago)

He killed himself because he got caught, not from any kind of remorse. If only Grok would have done the same.

(Obviously no CSAM would have been better but Grok's self-destruction would at least prevent more of the same, and take $ out of Elon's pocket)

[–] maniajack@lemmy.world 108 points 10 hours ago (5 children)

All the people who bought SpaceX stock invested in this. Grok is owned by SpaceX. It would be nice if journalists would put that in their articles.

[–] wonderingwanderer@sopuli.xyz 4 points 4 hours ago

The CSAM generator is in the index funds 🤢

[–] BarneyPiccolo@lemmy.today 12 points 6 hours ago

If you're driving a Tesla, you are funding CSAM.

[–] chiliedogg@lemmy.world 43 points 10 hours ago (1 children)

Lawsuits for this need to start including shareholders as defendants. Make investing in it a civil and reputational liability.

[–] OwOarchist@pawb.social 7 points 7 hours ago (1 children)

Lawsuits for this need to start including shareholders as defendants.

I get the sentiment, but ... they kind of already are.

Being a shareholder means you own part of the company. If the company stands to lose money from this lawsuit, then all the shareholders do as well. (That is, at least, on the somewhat naive assumption that a company's stock price has any relation whatsoever to how much money it has and can make.)

[–] pivot_root@lemmy.world 1 points 19 minutes ago* (last edited 16 minutes ago)

For shareholders and investors, the worst thing that can happen to them right now is the stock going down and having to take a loss on it. It's bounded by however much money they put into it.

If investing in 10 shitty companies knowing that 1 would fail manages to be more profitable than investing in 20 companies that don't degrade the moral fabric of society, there's a perverse incentive to keep investing in companies creating Groks. Making shareholders financially liable for the debts of their investments would introduce an unpredictable risk that could help change the equation.

[–] grue@lemmy.world 10 points 8 hours ago

Every US taxpayer invested in this, involuntarily.

load more comments (1 replies)
[–] green_goglin@thelemmy.club 1 points 3 hours ago* (last edited 3 hours ago)

Grok’s metal has to go bye-bye

[–] _fryerDan@sh.itjust.works 19 points 8 hours ago (2 children)

why are pedophiles so prevalent in todays society? jfc

[–] Imgonnatrythis@sh.itjust.works 6 points 5 hours ago

It helps people sleep better at night to think all these people are satanic monsters, but it's a mental illness that no one wants to admit to or talk about. Thankfully most of the afflicted control their thoughts and never take any horrific action. With gateways like Grok lowering the bar for experimentation with these types of ill thoughts, more people are starting to act in ways that bring this to attention. All technology can be used for bad things, but the good things these generative AIs can do are really so miniscule that there's no reason not to place strong legislative restrictions on them right now to limit abuse. That and maybe try to do something about the mental health crisis ravaging the US (and frankly much of the world right now).

[–] Killer57@lemmy.ca 9 points 8 hours ago* (last edited 8 hours ago) (2 children)
[–] AdolfSchmitler@lemmy.world 21 points 7 hours ago

Reminds me of that chart showing left handedness over time. I'm afraid the implication is that there have always been that many pedos in the world, we're just getting better at catching it publicly or something.

[–] Damage@feddit.it 4 points 6 hours ago

That's unsettling

[–] defaultusername@lemmy.dbzer0.com 7 points 6 hours ago* (last edited 6 hours ago) (1 children)

I don't know which one is more disturbing, the pedophile stepfather or the company that allows these kinds of pictures to be generated in the first place. Though Elon is also a pedo who begged Epstein to invite him to his pedo island, so...

[–] Grimy@lemmy.world 4 points 6 hours ago* (last edited 6 hours ago) (1 children)

They fought way too hard to protect the guy and it sounds like they aren't even running a csam filter, it's the gang rape keyword used in a prompt that got him flagged.

Gotta love how Lemmy has a CSAM filter, but a multi billion dollar company doesn't.

[–] honesthenery@thelemmy.club 2 points 4 hours ago* (last edited 4 hours ago)

What a fucking loser hahahaha. Thank gawd he is dead.

[–] TachyonTele_Esq@piefed.social 131 points 11 hours ago (1 children)

This entire thing from start to finish is horrifying.

[–] Marthirial@lemmy.world 65 points 11 hours ago (1 children)

Yes, from Elom being born all the way to buying Twitter.

[–] cecilkorik@lemmy.ca 35 points 10 hours ago (1 children)

The story was probably pretty horrifying before Elon was born too, from what we already know of his father.

load more comments (1 replies)
[–] 0li0li@lemmy.world 40 points 9 hours ago (1 children)

A major company makes CSAM generation platfor and sharing network, yet it does not get seized or closed by any government entity. Makes sense.

[–] AdolfSchmitler@lemmy.world 9 points 7 hours ago

It's for powerful people who are in government or paid off the right people. That's why it's allowed to exist. Until Elon loses his usefulness (aka money) and they need an excuse to bring him down.

That's my conspiratorial $.02

[–] limonfiesta@lemmy.world 28 points 9 hours ago

There's a reason why Ed Zitron refers to Grok as the CSAM generator.

[–] Rivermoonwolf@lemmy.world 22 points 9 hours ago

Every time a Republican says "think of the children!" I usually respond with "you are. With your hand in your pants".

Burn it to mother fucking ground. Then salt the earth.

[–] japemasterBrad@programming.dev 4 points 6 hours ago

Really feels like Elon will come up with some nonsense about 'I let Grok do that to weed out the nonces' like he's saving the fucking world

[–] Mediocre_Bard_Redeux@lemmy.world 69 points 11 hours ago (1 children)

Jesus Fucking Christ.

Just turn it off at this point.

[–] ImgurRefugee114@reddthat.com 13 points 8 hours ago

I don't think Elon want to turn off the CSAM creation machine, otherwise he probably would have some time between when he instructed the construction of the CSAM creation machine and now.

load more comments
view more: next ›