this post was submitted on 13 Oct 2026
169 points (92.9% liked)
Programmer Humor
33653 readers
2073 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
- If the mod doesn't find it funny, you're banned. Ha-ha!... For real: do not use the community for "statements". There are other places for such content. Keep it chill and funny.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This is scary if true. Imagine someone installing such model to some smart TV in some relaxation break room of a nuclear facility.
The chickens of security through obscurity are coming home to roost.
Dark days ahead
Sounds like a good reason not to make the devices capable of running LLMs, but nooo, smart devices must be pushed for at all times! The data harvest must continue...
Anything with a CPU and enough RAM can run a model if you do not give a single fuck about performance.
OK, well good luck running a model from storage (which is also going up in price, btw), I'm sure that hallucinated answer that comes out in six months will still be relevant!
Meh needs data center to run , unplug it and problem is gone
That’s the thing: it doesn’t need a data center. These are small local LLM distilled on cyber attack scenarios. They’re trained to lay low and copy itself to other devices in the network.
Once the breach has been detected, it’s already too late to unplug - they’re everywhere.
Except small local LLMs probably aren't good enough to carry autonomous tasks correctly (even stuff like Haiku 4.8 from Anthropic makes mistakes quite often) and good luck getting something the size of Opus working in a soda machine. They may not even be able to lay low correctly. But then again these companies have internal models which are atleast couple generations ahead of what is publicly available so maybe they have more efficient smaller ones too? I somehow find it hard to believe but I guess we will see.
They are bleeding resources so bad they wouldn't wait to put those efficient models in play. Every better model requires more and more resources.
You are on the money about the models not being good enough, let alone a harness. This whole worry is a nothing burger. Nobody outside of these labs has terabytes of RAM to run a model anywhere near a level of concern, let alone somehow distribute it across IoT devices or something. Anyone who has run a model locally knows how woeful a small model's abilities are.
This is just more Rationalist cult hand wringing. They believe they are building a digital god, so of course they are dreaming all of this nonsense up.
But do they actually? The release cycle and also how often there were obvious flaws in the releases suggest that they are all fighting aggressively for market shares and release every new perceived improvement as it comes to try to stay on top.
The math problems they have been solving lately suggests that they do. But then again they throw thousands of agents at the problems to get them solved so I don't know how much of it is a number thing and how much is a model thing.