this post was submitted on 17 Oct 2026
135 points (91.4% liked)
Technology
88848 readers
3957 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Neat! This stuff should not run in data centers anyway. And it should not be gated and controlled by billionares.
Training these models still requires massive data centers, and using any of them that at all compare to frontier models for inference requires large numbers of GPUs
It does for now, but the methods for modifying an LLM are getting increasingly sophisticated. From blending models to doing brain surgery on them to fine tune the weights, there's a lot of new techniques being developed all the time
There's also recently been a breakthrough that cut the ram requirement to 1/6, eventually someone is going to figure out how to train models orderes of magnitude more efficiently
Especially once the AI bubble pops and no one is willing to dump billions into constant iterations