this post was submitted on 10 Oct 2026
372 points (97.9% liked)

Technology

88848 readers
3718 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] AstralPath@lemmy.ca 12 points 6 days ago

I'm so burnt out and jaded on AI that I don't think I'll ever use it for any reason ever. I just wish we could put the cat back in the bag. I know that will never happen.

[–] eestileib@sh.itjust.works 13 points 6 days ago (1 children)

Nephew calling a 1.25% drop a "tailspin".

Look up the Flash Crash sometime, that is NOTHING.

[–] TheStaffmaster@lemmy.world 8 points 6 days ago* (last edited 6 days ago) (3 children)

I'd suggest that the 1929 stock market crash get an entire unit in elementary school, High school, and every economics course in college. Do the same for the 89' crash and the Dot com Bubble. Really drill it into these young entrepreneurs how Speculating in the stock market NEVER EVER leads to anything good. It's a Faustian bargain. The consequences WILL arrive; not a matter of "if" but "when."

load more comments (3 replies)
[–] Modern_medicine_isnt@lemmy.world 10 points 6 days ago (1 children)

"more clear that the real future of AI is small language and open-weight models running on local desktop computers" So where are we with those smaller models? I haven't been following them. Are they any good?

[–] iocase@lemmy.zip 8 points 6 days ago* (last edited 6 days ago) (2 children)

Qwen3.8-flash-next is making waves since its near frontier or frontier (according to some i havent used it) that can be run on an ancient 8GB video card (12GB or more is recommended. 16GB is best.) with around 32GB of RAM using Strata.

Strata

It's a mixture of experts MoE model, so while it's around 66GB (depending on which quantization you decide to run) you're only really using about 6B parameters per token processed, meaning the VRAM requirements are a lot lower.

I personally don't see the value proposition in paying $4/1M tokens when i can generate around 30tok/s on 500W of power. I pay ¢13/kWh so to generate 1M output tokens takes me 9.25 hours and costs $0.60.

I'm also running an ancient video card and have a new one in the mail. If i got 200 tok/s even at higher power use i'm still a fraction of the cost of paying for API access and I want that GPU for other things regardless.

I feel lile medium and large businesses have a strong incentive to rent or buy inference using open weight models for a fraction the cost of paying OpenAI or Anthropic. Especially if you can pre load them with everything about your org to make them better suited for internal use.

The vast majority of uses can use a open weight locally run model. I think you would only want to pay for frontier models for really complex tasks with lots of steps, and even then there are usually ways to be smart about how you task agents with work to get better output and use less money.

[–] bashibazouk@lemmy.world 2 points 3 days ago

The other issue is we are finding out that what you do in the AI cloud is logged. It can be subpoenaed, can be sent to police if it fails a safety check, or even stolen if the mathematicians fears are real. It is certainly being used to further train models...

[–] Modern_medicine_isnt@lemmy.world 2 points 5 days ago (1 children)

Nice. I just wondered how they were coming along.

Right now, I have to manage which model does what. So I don't. It's the companies dime after all, and they clearly value speed over efficiency. But the model I directly talk to doesn't need to be super high end. It could be well versed in which model is best for what task and farm put all of the work to the right model for the job. Seems like that alone could reduce cost a ton. But then start adding in cheaper local models and the price could fall a ton.

It would also be more accurate. Like if I had a small local model for interacting with a set of apis. It wouldn't make the mistake of not considering that the api paginates results. The general model makes this mistake over and over.

So I agree this is the direction of the future. Just trying to figure out when we will get there.

load more comments (1 replies)
[–] ProwlsInSoup@lemmy.world 10 points 6 days ago (8 children)

Please let it happen. Please! Hopefully datacentres gets demolished also or turned into puppy orphanages.

[–] chiliedogg@lemmy.world 6 points 6 days ago

Some datacenters could be repurposed as traditional datacenters focused on networking and cloud storage, infrastructure.

load more comments (7 replies)
[–] switcheroo@lemmy.world 8 points 6 days ago* (last edited 6 days ago) (3 children)

AI could be used to save our planet from catastrophic climate change, to problem solve ways to improve things, to do hard labor so that people don't have to... but nah let's use it to make assholes with too much money get more money! That's fantastic

[–] Tollana1234567@lemmy.today 6 points 6 days ago

its doing exactly opposite of that, i dont think it will save anything, its already catastrophic enough to have all these polluting datacenters in every country.

[–] benjirenji@slrpnk.net 6 points 6 days ago (1 children)

We already got solutions. What's missing is the courage and incentives to actually adopt them by political leaders and the larger public. If AI would replace our politicians maybe it could help, otherwise it's just the latest proof that there's plenty of money around to transform the economy into whatever we want it to be. I guess we prefer chat bots over carbon neutral.

load more comments (1 replies)

They didn’t listen to the scientists.

Somehow I think AI would go from “Super Intelligence” to “that libtard tree hugging computer made of parts from commie Chy-na” as soon as it told them to do something legit that would inconvenience them or disagree with their narrative.

[–] MasutaHarada@thelemmy.club 10 points 6 days ago* (last edited 6 days ago) (1 children)

There are lot of problems in this world that make artificial intelligence dooming humanity seems like tuesday in comparison , and those problems got similar treatment from all of humanity: protest, hearing, discussions and a bit of outlier that spark things a bit and after that moved on to another problem without solution a.k.a status quo till everything collapse.

I mean why a.i dooming entire humanity begets different treatment?

[–] Regrettable_incident@lemmy.world 4 points 6 days ago (2 children)
[–] MasutaHarada@thelemmy.club 14 points 6 days ago (1 children)

I put my stake to ongoing environment collapse like sane person here.

[–] NonconfrontationaI@lemmy.ml 9 points 6 days ago (1 children)

The fact that more people don't know just how far past the point of no return we are is still shocking sometimes.

[–] uszo165@futurology.today 5 points 6 days ago (1 children)

Yes, and many of those who know think countermeasures suddenly became futile. Rather, the time when mitigation is easiest and most effective is always exactly now. So, whatever anti-collapse action (or inaction) you all put off or planned for “later”, start it today. You will never again have a chance to have this impact.

load more comments (1 replies)
load more comments (1 replies)
[–] FE80@lemmy.world 8 points 6 days ago

Hope the fuckers all burn.

[–] gwl@lemmy.blahaj.zone 6 points 6 days ago (1 children)
[–] floquant@lemmy.dbzer0.com 6 points 6 days ago

Yeah, Bloomberg though. Not saying that they are great, but it's among those that Wall Street bros read to decide what to buy and sell

[–] myyass@lemmy.world 2 points 6 days ago

The lobster is out, read the room. You're seeing articles of people stating local models are the future in tandem with hardware companies stating prices will go up for hardware and shortages will remain. This is a classic double tap from behind. It's done. There were some good applications to it, which will continue. But overall it's a toddler dropping their ice cream cone on the ground.

load more comments
view more: next ›