this post was submitted on 09 Feb 2026
554 points (98.9% liked)

Technology

80990 readers
4824 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

you are viewing a single comment's thread
view the rest of the comments
[–] zewm@lemmy.world 2 points 1 day ago (1 children)

It is insane to me how anyone can trust LLMs when their information is incorrect 90% of the time.

[–] SuspciousCarrot78@lemmy.world 2 points 15 hours ago* (last edited 15 hours ago)

I don't think it's their information per se, so much as how the LLMs tend to use said information.

LLMs are generally tuned to be expressive and lively. A part of that involves "random" (ie: roll the dice) output based on inputs + training data. (I'm skipping over technical details here for sake of simplicity)

That's what the masses have shown they want - friendly, confident sounding, chat bots, that can give plausible answers that are mostly right, sometimes.

But for certain domains (like med) that shit gets people killed.

TL;DR: they're made for chitchat engagement, not high fidelity expert systems. You have to pay $$$$ to access those.