this post was submitted on 01 Oct 2025
103 points (99.0% liked)
Fuck AI
4198 readers
902 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm posting this because it's a great example of how LLMs do not actually have their own thoughts, or any sort of awareness of what is actually happening in a conversation.
It also shows how completely useless it is to have a "conversation" with someone who is just in agreeability mode the whole time (a.k.a. "maximizing engagement mode") -- offering up none of their own thoughts, but just continually prompting you to keep talking. And honestly, some people act that way too. And other kinds of people crave a conversation partner who acts that way, because it makes them the center of attention. It makes you feel interesting when the other person is endlessly saying, "You're right! Go on."
LLMs work best when used as a mirror to help you reflect on your own thoughts, as that's the only thinking going into the process. This isn't how most people are using it.
this is an effect known for almost 60 years now https://en.wikipedia.org/wiki/ELIZA_effect
That is interesting, I hadn't heard of that.