this post was submitted on 13 Oct 2026
79 points (98.8% liked)

Technology

88763 readers
2283 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 15 comments
sorted by: hot top controversial new old
[–] schipelblorp@sh.itjust.works 21 points 2 hours ago (3 children)

Guessing re-creating a whole ass person with a personality that considers everything you've told it is actually quite a bit more expensive than people want to pay for.

Anyway, it's good news if these freaks start running their bots locally instead.

[–] Voroxpete@sh.itjust.works 15 points 1 hour ago (1 children)

Basically, yes.

This comes back to the basic problem with LLMs as a business proposition; any digital service can either be cheap and frivolous, or expensive and necessary. You can even, if you do things right, be cheap and necessary. But you cannot ever be expensive and frivolous.

LLMs were supposed to be expensive and necessary, but it turns out they're just so unreliable that they simply cannot perform an essential role. They must always be disposable; fun, or useful, but never essential.

Which leaves only cheap and frivolous as an option. And they're just not cheap, nor does it seem likely that they ever will be.

So you get Character.ai filling chapter 11, because people simply will not ever pay what it actually costs to run these models just so that they can have a computer program pretend to be Lois Griffin for them.

[–] schipelblorp@sh.itjust.works 5 points 1 hour ago (1 children)

With the added wrinkle that there are expensive things that may be necessary-ish, but when you exclusively use it for those things, the price jumps up to insanity.

Now that people are shunting easier requests to local models and sending the harder problems out, the hyper scalers have less income, so they have to charge more.

Because eventually the only real limitation will be hardware, that kind of AI will be a rarely-used commodity priced only slightly above what it would cost you to recreate it inside your business.

Not to mention the privacy concerns you'd have sending your expensive and necessary compute to the cloud.

[–] Voroxpete@sh.itjust.works 2 points 42 minutes ago

Now that people are shunting easier requests to local models and sending the harder problems out, the hyper scalers have less income, so they have to charge more.

While you're 100% correct about the fact that this is happening, and it is a serious problem for the hyper-scalers, it's really, really important to note that even before this started happening, LLMs were already hilariously unprofitable, both on the software and the hardware side. For the AI companies, there is simply no way to charge people what the models actually cost to run and still turn a profit. On the data-centre side, the turnover on burned out GPUs is going to annihilate any hope of profitability. They're treating as capex what is essentially a consumable and their business models simply do not account for this reality.

The behaviour you're identifying here is basically just a swift kick in the guts to someone who was already bleeding to death from several bullet wounds. Seriously unhelpful, but not remotely the impending cause of death.

[–] clay_pidgin@sh.itjust.works 2 points 56 minutes ago

And I'm sure they'll sell their users' private conversations to the next AI scum.

[–] NateNate60@lemmy.world 5 points 1 hour ago* (last edited 1 hour ago) (2 children)

The environmental impact of AI would be a tenth of what it is now if people just ran whatever models they want on their own local machines. We're mortgaging the next fifty years worth of compute power and meanwhile mfs who talk to virtual girlfriends on their $2,000 gaming PC have trillions of FLOPS of compute power sitting right next to them.

[–] chaospatterns@lemmy.world 1 points 5 minutes ago

That doesn't check out unless ignoring model size. Just from an operations perspective a data center had economies of scale and the ability to batch up multiple independent user's requests which should reduce the per token kWh along with the fact that your utilization will be higher vs somebody's GPU at home would be idling.

That said I do believe there are negative environmental impacts from AI like always using giant frontier models for everything instead of smaller fine tuned models.

[–] schipelblorp@sh.itjust.works 5 points 1 hour ago

Why is that? The electricity burned is about the same, no? Of course, the impact is more distributed.

I think the difference would be that local machines aren't subsidized, so you'd see people get a lot more skittish after that first electric bill. Data centers are like railroad tracks from the railroad boom (if they'd made the rails out of licorice twizzlers.)

[–] howdy@lemmy.ml 4 points 58 minutes ago

Delicious. Finally some good fucking news

[–] GreenKnight23@lemmy.world 1 points 18 minutes ago

it's happening

every flood starts with a trickle.

[–] lemmyng@lemmy.world 2 points 43 minutes ago

lol. lmao even.

[–] AceFuzzLord@lemmy.zip 1 points 30 minutes ago

WormsArmageddonThrowHolyHandGrenade.mp3

[–] driving_crooner@lemmy.eco.br 10 points 2 hours ago (2 children)
[–] FaceDeer@fedia.io 3 points 28 minutes ago

If you weren't running her locally she was never yours in the first place.

[–] raman_klogius@ani.social 5 points 1 hour ago* (last edited 1 hour ago)

AIncels would cry that they killed their waifus and be driven to ride a sewer slide 🥀