this post was submitted on 25 Nov 2025
97 points (83.4% liked)
Fuck AI
4728 readers
1252 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The reason why "we" have these models because they were deliberately trained not to output random noise. That part is well understood.
The only reason why we don't know what exactly makes the model output an image of Garfield with boobs is the amount of data to sift through. Not because we don't understand the processes.
Generalization is not a given. It’s possible to make complex models that perfectly memorizes 100% of the training data, but produces garbage results if the input diverges ever so slightly from the training.
This generalization is a process that’s not fully understood. Earlier architectures struggled with this level of generalization, but transformers seem to handle it well.
Not overfitting is hard, yes. But it's not "we have no idea how/why this works"-hard.