this post was submitted on 01 Sep 2026
237 points (90.7% liked)

Technology

87742 readers
3480 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] MangoCats@feddit.it 3 points 2 hours ago* (last edited 2 hours ago)

I find that depends a LOT on what you're asking the LLM to write, how well you're specifying it, etc. As for the code reviews, if it's code that matters: remember to open a new instance and ask the exact same question again on the code that has been reviewed and "fixed". Back a year ago, that could get you into a waffle-loop where the engine would change its mind back and forth about what's optimal and just oscillate between the two. These days they seem to record (and read) enough context to prevent that behavior, but I definitely get behavior of: "Are there any bugs?" "Yes, here are seven bugs." "Fix those bugs." "The bugs are fixed." (and they ususally really are...) "Are there any more bugs?" "No, we have fixed ALL the bugs." "Are you sure, look again." "Yes, I am sure we have found and fixed ALL the bugs."


new context window


"Are there any bugs?" "Yes, here are seven bugs." different bugs.

I did that on a bigger project and literally repeated 20 times, finding 140 real bugs - granted, the later bugs were getting pretty trivial / far out edge cases, but they were still real, still fixed, still denied there were any more bugs until opening a fresh context and asking again. This was on Google's Gemini 3.7 Flash High... Claude Opus 4.8+ seems quite a bit better about being able to continue in a context without becoming blind to issues "it has already solved."