this post was submitted on 28 Nov 2025
206 points (99.0% liked)
Fuck AI
4728 readers
278 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yeah, I think it's ridiculous to blame ChatGPT for this, it did as much as could be reasonably expected of it, to not be misused this way.
Source.
Well, if that's not part of him requesting ChatGPT to role-play, that's fucked up.
Legit doesn't matter. If it had been a teacher rather than ChatGPT, that teacher would be in prison.
At the heart of every LLM is a random number generator. They're word prediction algorithms! They don't think and they can't learn anything.
They're The Mystery Machine: Sometimes Shaggy gets out and is like, "I dunno man. That seems like a bad idea. Get some help, zoinks!" Other times Fred gets out and is like, "that noose isn't going to hold your weight! Let me help you make a better one..." Occasionally it's Scooby, just making shit up that doesn't make any sense, "tie a Scooby snack to it and it'll be delicious!"
Yeah, because a teacher is a sentient being with volition and not a tool under your control following your commands. It's going to be hard to rule the tool deliberately helped him in planning it, especially after he spent a lot of time trying to break the tool to work in his favor (at least, it's what is suggested in the article, and that source doesn't have the full content of the chat, just the part that could be used for their case).
I guess more mandatory age verification are coming because parents can't be responsible for what their kids do with the devices they give them.