this post was submitted on 14 Jul 2026
922 points (98.9% liked)
Programmer Humor
32303 readers
1885 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What evaluation setup lets the thing being tested see the test results and gives access to the test source code?!
Slop evaluating slop.
Given that they mark it as cheating, isn't that essentially part of the test in itself?
The model is so smart, we let it write it's own evaluation setup /s