this post was submitted on 09 Feb 2026
550 points (98.9% liked)

Technology

80928 readers
4862 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

you are viewing a single comment's thread
view the rest of the comments
[–] leftzero@lemmy.dbzer0.com 16 points 23 hours ago (2 children)

LLMs don't have the mind of a five year old, though.

They don't have a mind at all.

They simply string words together according to statistical likelihood, without having any notion of what the words mean, or what words or meaning are; they don't have any mechanism with which to have a notion.

They aren't any more intelligent than old Markov chains (or than your average rock), they're simply better at producing random text that looks like it could have been written by a human.

[–] plyth@feddit.org 3 points 16 hours ago (2 children)

They simply string words together according to statistical likelihood, without having any notion of what the words mean

What gives you the confidence that you don't do the same?

[–] pkjqpg1h@lemmy.zip 2 points 6 hours ago

because I don't just look the words I know and feel their meaning, and I'm aware of process (this is why ALL LLMs is vulnurable to Promt Injections) also talking about Promt Injection think about when ChatGPT confidently give you an advice that would kill you because of prompt injection

[–] Digit@lemmy.wtf 2 points 13 hours ago

human: je pense

llm: je ponce

[–] IratePirate@feddit.org 3 points 20 hours ago

I am aware of that, hence the ""s. But you're correct, that's where the analogy breaks. Personally, I prefer to liken them to parrots, mindlessly reciting patterns they've found in somebody else's speech.