this post was submitted on 23 Feb 2026
458 points (97.7% liked)

Technology

81772 readers
3973 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

(page 4) 33 comments
sorted by: hot top controversial new old
[–] JustTesting@lemmy.hogru.ch 1 points 11 hours ago (1 children)

10 tests per model seems like way too little and they should give confidence intervals…

the 10/10 vs. 8/10 is just as likely due chance than any real difference. But some people will definitely use this to justify model choice.

load more comments (1 replies)
[–] xav@programming.dev -2 points 8 hours ago (1 children)

Mistral (the free version) seems to get it right. Maybe they fixed it specifically ?

Drive. Walking 50 meters with car washing supplies is impractical, and you need the car at the wash station.

1000080933

load more comments (1 replies)
[–] Rhoeri@lemmy.world -4 points 14 hours ago

I remember years ago getting downvoted into oblivion both here, and on Reddit for saying that AI would be a disaster.

[–] Rentlar@lemmy.ca -5 points 16 hours ago (1 children)

Kinda neat about the human responses... sure some are trolling but maybe we have to test our global expectations. In North America, a car wash tends to be this garage thing with either automated cleaning or a set of supplies to clean your car, and your car has to be in the shed to be cleaned effectively. But if washing your car by hand is the norm, I wonder if people in some countries surmise that the cleaning staff could just walk over with the sponges, buckets and hoses and stuff to the car, if you're already 50 metres away from the washing point.

load more comments (1 replies)
load more comments
view more: ‹ prev next ›