223
Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.
(www.theatlantic.com)
this post was submitted on 15 Jul 2026
223 points (97.0% liked)
Technology
86354 readers
3208 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
But it’s so good at programming if you already know how to program! Surely that’s worth burning the planet and crashing the world economy??
Actually still no
https://github.com/JustVugg/colibri
Everyone was desperate to be first because capitalism. But we are getting good models without the insane build out requirement. Which will be hilarious to leave the cunts holding the bag. Not that the planet is better for it in the end.
~1 token per second (storage bound gen4 nvme)... Some of us have places to be.
Don't get me wrong. Its impressive that it can run at all, but honestly the usecase is exceedingly narrow. You'd have better results with a structured quantized gpu-only gemma or qwen workflow. Quality over quantity, rely on validation and a structured process: lots of cross-model review and iteration loops with spec and test driven dev. You could probably get a working alpha by the time colibri set up the environment.
Yeah I'm just beginning my local AI journey on a 5080, tried Qwen3.6 27b Q4 and was getting like 1tps because of the vram overflow. Ran it over night at it was still chewing on generating a prompt for a sub agent when I got up in the middle of the night until it simply ended in some kind of "fetch failure" lol. I think I gave it something too large to tackle, but either way 1tps is kinda garbage.
Wow I’m starting to feel bad about that time I asked AI to make a joke about scatology & eschatology sounding similar.
You could use the 35B MoE model, tune it a little bit and get much better results. I have a 5060 ti and 70-80 tok/s are the norm
That's what I generally use. I wanted to see if I could use the 27b to "review" what the 35b put out. The 35b has been working pretty well, but it's not very thorough. I asked it to make a program and then 27b was like "this is a skeleton, there are folders but no contents." Lol
Is that quantized? 4 bit Qwen 3.6 can get 22tps on a 1060.
It's the q4 quantization, but it requires 20+GB vram and my 5080 only has 16
All for software that'll be out of date and fashion next year!