this post was submitted on 17 Sep 2026
161 points (94.5% liked)

Technology

88745 readers
2375 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
161
Everybody's Lost Their Minds (www.netmeister.org)
submitted 3 weeks ago* (last edited 3 weeks ago) by inari@piefed.zip to c/technology@lemmy.world
top 21 comments
sorted by: hot top controversial new old
[–] DarrinBrunner@lemmy.world 46 points 3 weeks ago (2 children)

I suppose I should quote a part, since no one else will read the dreaded wAlL Of tEXt.

Is this short enough for you?

AI helps people find more vulnerabilities in existing code. To address those vulnerabilities, people use AI to generate patches. The resulting pull requests are then "reviewed" by AI. That is, the more AI is in the loop, the less we understand the code base. The mystical "human in the loop" often is nothing more than a rubber stamp.

So what happens when things go bump? Complex systems fail in complex ways, and debugging code is an order of magnitude harder than writing code. Debugging somebody else's code is harder still. Trying to debug large, complex, distributed systems consisting of components that are effectively opaque to your entire organization is going to be impossible.

[–] MalReynolds@slrpnk.net 17 points 3 weeks ago (1 children)

You know what's harder than debugging? Maintenance, especially of someone else's code, keeping up to date with security exploits, revamping UX etc. which is why github is full of write only (as in never read, never changed) slop projects. That's a critical part of a software project with any lifespan.

And then there's integrating new functionality.

Without a solid architecture (which AI sucks at), strict code readability standards (ditto, but improving) and nuanced reviewing of potential additions to the codebase (ditto) what you get is a spagettified mess. It ends up costing more to maintain and improve than just starting fresh.

The promise of the AI bros was that by the time you needed to maintain or extend, you could just get the next version of Claude or whatever to do it, as it's capabilities would have improved. That was a lie, and LLMs have hit a logarithmic wall where throwing more compute and bigger training sets at it produces diminishing returns. No AGI for you (unless some genius finds a new architecture). Frameworks / harnesses are still improving, but there's only so far that can go.

The amount of technical debt that has been racked up by the last two years of AI coding is staggering to contemplate, and the industry will be dealing the fallout for years. Companies will collapse, and god help you if you've used it liberally in a codebase as large as an OS - looking at you Microslop.

[–] Yaky@slrpnk.net 9 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

As someone said a long time ago (way before the LLM craze) "bad developers love new projects, they can write terrible code, take praise and zero responsibility, then toss it to the maintenance (actual) team who has to deal with it".

(Context: in at least 2 companies I worked at, it was a common practice to have a "development team", usually with knowledge of latest tools and frameworks, but very little knowledge of processes or industry, and an "application team" that maintains the software long-term, and deals with the processes and users directly)

[–] MalReynolds@slrpnk.net 4 points 3 weeks ago (1 children)

Been there, burned the TShirt...

[–] atrielienz@lemmy.world 2 points 3 weeks ago

Because it was infected or as a protest?

[–] spiffmeister@aussie.zone 6 points 3 weeks ago

since no one else will read the dreaded wAlL Of tEXt.

It's okay I can just have an AI summarise it for me.

[–] treadful@lemmy.zip 26 points 3 weeks ago (2 children)

The other day I went to talk to some subject matter expert because I wanted an experienced human's knowledge and perspective on my problem. They literally just read me Reddit posts and Gemini search results to answer my questions. Even turning their laptop and being like "see?"

What a waste of everyone's time.

[–] ImmortalColeSlaw@lemmy.today 11 points 3 weeks ago

God forbid we think for ourselves and have real conversations.

[–] frongt@lemmy.zip 3 points 3 weeks ago (1 children)

Maybe they were exercising their experience by identifying valid material. No point rewriting a treatise when some guy's blog already has a perfectly good article.

[–] treadful@lemmy.zip 2 points 3 weeks ago

Again, it was AI answers and a reddit post.

[–] MangoCats@feddit.it 16 points 3 weeks ago (2 children)

I will say, we've been deployed on Ubuntu 18.04 for 8 years now and tracking the CVEs against our configuration watching for potential exploits that could really matter to our systems, and it wasn't until the past few months that those exploits actually started to get meaningful ability to compromise us.

What that says to me is: the LLMs are finding meaningful vulnerabilities that "the best minds" missed for years and years. And they're also generating functional patches for these vulnerabilities far faster and more easily than the patches came out in the past.

I'm not loving the changed landscape, but I have to acknowledge that LLMs are making a significant difference.

[–] Blue_Morpho@lemmy.world 4 points 3 weeks ago (1 children)

Yeah I got to this in the blog and stopped:

" I don't think that we're any safer than before. That's because finding vulnerabilities has never been the bottleneck in information security. The bottleneck isn't even verifying a vulnerability report and validating its severity, as time consuming as that is. The bottleneck isn't determining the fix, creating the patch, or publishing a new release. The bottleneck is still, as ever before, getting the goddamn packages updated. "

Dude thinks security through obscurity is valid and thinks running

sudo apt update && sudo apt upgrade -y

Is the really hard part.

[–] MangoCats@feddit.it 2 points 3 weeks ago

running

sudo apt update && sudo apt upgrade -y

Is the really hard part.

That's not the hard part to do, it's the hard part to get other people to do, particularly those who can't just run the package manager or let in-doze play patch roulette every Tuesday.

Security through obscurity isn't going to cut it in the future, much less than it already didn't in the past.

Security through air-gapping is still pretty good.

[–] abcdqfr@lemmy.world 2 points 3 weeks ago

It isn't even the LLM. Its the data scraped from the internet wholesale and users contributing to corps by use. Not to mention the staggering amount of engineers turning that raw data into better output. The LLM just spits those billions of dollars of effort back out. I only pick this nit because too many people see local LLM and think that's where the magic happens. It is just a flash in the pan. you need an internal combustion engine, transmission, wheels, chassis, cabin, and probably some seats if you want to get anywhere with it. That said, it is the concentration of effort. Individuals can't really rival that. I wonder if there are any initiatives in the open source community with this mindset...

[–] onmt602@lemmy.world 9 points 3 weeks ago (1 children)

I'm also feeling burnt out and I barely use it. The reliance is real. But the novelty is gone.

I saw some headline talking about an upcoming interview with the world's first AI actor. But...why?

Someone has taught their dog better and better tricks. It's still a dog!

[–] Telorand@reddthat.com 3 points 3 weeks ago

More like somebody taught their calculator to spell OBOE ShOES. It's still a calculator.

[–] cheese_greater@lemmy.world 5 points 3 weeks ago

Guilty 💅

[–] myyass@lemmy.world 5 points 3 weeks ago

The first line is a form of self therapy. I really like the Blade Runner line "like tears in the rain" because it brings understanding of insignificance. My thought is llms are starting to show their insignificance to benefit society; not that they can't beneficial for certain task but overall. It's just an opinion.

[–] bridgeenjoyer@sh.itjust.works 5 points 3 weeks ago

Yeah, I'll keep quoting the mantra of the 20s, "everything sucks now. You'll own nothing and be happy". I'll go back to my early 2000s cave now.