this post was submitted on 14 Jul 2026
209 points (94.1% liked)

Technology

86354 readers
3187 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] mecen@lemmy.ca 6 points 17 hours ago

For $100k probably

[–] eicker@lemmy.world 29 points 1 day ago (3 children)

1.5 TB of unified memory sounds less like a computer and more like Apple preparing for the moment your local AI starts asking for a raise. Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

[–] plyth@feddit.org 2 points 16 hours ago (1 children)

Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

Won't at least China have production capacities ready by then that make the price drop?

[–] eicker@lemmy.world 2 points 16 hours ago (1 children)

Nope, it‘ll take several years to catch up.

[–] plyth@feddit.org 2 points 16 hours ago

https://feddit.org/post/32576427

Their DDR5 chips are 30% more expensive, but they are willing to sell 10% below market rates.

The article says that they won't catch up in 2027 but I expect China to pour in resources to catch that opportunity.

[–] mecen@lemmy.ca 1 points 16 hours ago (1 children)

Doesn't big companies try open models. Microsoft was testing deepseek.

[–] eicker@lemmy.world 2 points 16 hours ago (1 children)

Everyone is. Open weight and source is the way to go in my opinion.

[–] mecen@lemmy.ca 1 points 16 hours ago (1 children)

But I bet next they will close it after gaining bigger foothold. I wonder how would you prevent this.

[–] eicker@lemmy.world 2 points 16 hours ago (1 children)

I don’t think open-weight models can be prevented, as ‘everyone’ knows how distillation works these days and, clearly, no one can do anything to stop it.

[–] mecen@lemmy.ca 1 points 16 hours ago (1 children)

No turn deepseek and others to proprietary models

[–] Railcar8095@lemmy.world 1 points 14 hours ago (1 children)

Whatever was open will remain open, even if newer change the license.

[–] mecen@lemmy.ca 1 points 13 hours ago

Yes, but expertise is not there and when they will lead in ai they will turn it into proprietary software. Afterwards no-one will know how to develop it further.

At least I think so.

[–] AA5B@lemmy.world 10 points 1 day ago (2 children)

Remember this is “unified”, it’s not like you can upgrade, nor is it available in the “cheap” packaging we’re used to.

You’ll get whatever Apple puts on the SoC, and you’ll be happy with it

[–] eicker@lemmy.world 9 points 1 day ago (1 children)

The upside is that unified memory is genuinely different from traditional RAM. The CPU, GPU and Neural Engine all share the same memory pool, so data doesn’t need to be copied back and forth. That reduces latency, improves efficiency and lets AI models, graphics and other workloads access much larger datasets. It also uses less power and saves board space. The downside is obvious: because it’s integrated into the chip, you have to choose the right amount upfront, since it can’t be upgraded later.

[–] NotMyOldRedditName@lemmy.world 4 points 1 day ago* (last edited 1 day ago)

Ya, these high memory amounts and ever increasing memory bandwidth are heavily (but not only) targeting people wanting to run local large AI models like a full deepseek on their machines.

You might not be able to train as well on them as NVIDIA + CUDA, but for local inference, they're an alternative to NVIDIA and more reasonably priced for the model sizes you can run, and each iteration they get better as the bandwidth increases.

[–] NotMyOldRedditName@lemmy.world 6 points 1 day ago (1 children)

Apples memory has never been cheap, it's always been a very expensive upgrade.

[–] BigPotato@lemmy.world 3 points 22 hours ago (1 children)

I slowly turn to dust as I recall cracking open 2013 MacBook Pros and just putting more memory in.

The memories of loading up the G3 with SDRAM so I can fiddle with Photoshop 5, lost like tears in the rain.

[–] NotMyOldRedditName@lemmy.world 4 points 21 hours ago

How dare you steal hundreds of dollars by installing contraband ram!

[–] khepri@lemmy.world 9 points 1 day ago

There's going to be a massive boom in local llms if we get there. Already I have replaced ~80% of my paid token usage with a small local model running on my 64gb macbook pro, but being able to run a full-fidelity multi-hundred-billion parameter llm locally would be a game changer for my use case at least.

[–] Mereo@lemmy.ca 123 points 1 day ago* (last edited 1 day ago) (3 children)

Basically Apple will be building the perfect computers to run local LLMs.

[–] foodandart@lemmy.zip 93 points 1 day ago (14 children)

One can only hope that it totally breaks the AI/LLM at industrial scale, so businesses can run their own AI systems with their own data sets.

No more of this fucking datacanter horseshit.

[–] Whostosay@sh.itjust.works 40 points 1 day ago (1 children)

It's pretty obvious at this point that the data centers are for storing massive amounts of video.

[–] crispbacon99@lemmy.zip 4 points 21 hours ago

Where else will flock put all their recordings of us

load more comments (13 replies)
[–] SuspiciousCarrot78@aussie.zone 4 points 1 day ago* (last edited 1 day ago) (3 children)

I guess it depends on your definition of perfect - cheap, good or fast.

This thing is probably going to cost at least $20K USD.

Edit:

"Next year's base M7 processor is expected to arrive in the first half of 2027 and will also upgrade memory bandwidth to about 240 GB/s."

That's...really fucking slow. What's the goal here - CGI, engineering sims, game dev etc? 1.5TB is cool but at 240GB/s that will crawl for AI use.

Comparison: this is about $100K, for 7.2TB/s, 252GB VRAM (+500GB system ram, so closer to 750GB total)

https://www.nvidia.com/en-us/products/workstations/dgx-station/

[–] mitchty@lemmy.sdf.org 1 points 8 hours ago

It’s likely wrong reporting, the m5 ultra gets 614 GB/s today. The m3 pro gets over 800. The rumored m5 pro is 1.2TB/s. Likely this will be 2.4 TB/s, but half the reason for high bandwidth in nvidia chips is somewhat offset in the unified scheme. Mlx needs a lot less copy data around when the gpu can just read it directly.

[–] NotMyOldRedditName@lemmy.world 3 points 1 day ago* (last edited 1 day ago)

Something got reported on incorrectly because the M5 Max's have 614 GB/s today, and the Ultra M4 machine's (not laptops) are 819 and that's 3 generations behind a M7 if they make an M7 ultra machine.

$ for $ you'll get more video ram than paying for a 5090, but it won't be as fast and can't train well.

Before the ram price decable, you could get a 192gb M4 Ultra for ~10k CAD.

[–] REDACTED@infosec.pub 1 points 23 hours ago

While Apple computers generally will have better support, they will be very slow due to unified memory itself. I'm not sure if this is actually the future.

[–] puppinstuff@lemmy.ca 1 points 22 hours ago

Only if they can figure out how to emulate CUDA. Or maybe more containers will start providing alternatives if the machines are popular enough?

There’s still a lot of image and OCR workflows I have to chug through the CPU and it takes forever.

[–] phoenixz@lemmy.ca 8 points 1 day ago (1 children)

You'll only be able to afford 640KB, but it CAN go to 1.5TB!

load more comments (1 replies)
[–] ryper@lemmy.ca 76 points 1 day ago* (last edited 1 day ago) (3 children)

A Mac with 1.5TB RAM would be expensive at the best of times. In 2027/2028 it might approach $50k, or even get into 6 figures.

[–] h0rnman@lemmy.dbzer0.com 9 points 1 day ago

With the Apple tax, I'd expect 1.5TB to run you closer to $200k. Enterprise prices are that high today, so if trends continue it's going to be bad

[–] lepinkainen@lemmy.world 20 points 1 day ago

Big household name gaming companies have devs who burn 20k in tokens A MONTH.

A 50k machine that can run a model locally with 0 monthly costs will pay for itself in 3 months.

[–] foodandart@lemmy.zip 28 points 1 day ago (2 children)

It shouldn't be, if Apple gets that import exemption from the Chinese memory manufacturer (ChangXin Memory Technologies) they are asking for. Apparently they're already testing the CXMT chips to put in the phones sold in China, freeing up the orders/stock they've sourced already from "safe" sources, to go into their products sold in the rest of the world.

Smart move if they can finagle it.

Hopefully they can get it through before the fuckwits in the administration understand how effectively it can threaten the big AI players that Trump seems to be sniffing around.

You absolutely BET that he will scuttle any trade deal if it interferes with his own personal agenda WRT his investments in AI.

He's that much a greedy cunt.

[–] Fizz@lemmy.nz 18 points 1 day ago (4 children)

apple sells ram at double market rate in the cheapest of times

[–] foodandart@lemmy.zip 1 points 57 minutes ago

Indeed, but as a decades-long apple user, I've never bought RAM through Apple. Hell, I never even got it through Otherworld, as that was almost as spendy. Ebay.. just go to ebay.

load more comments (3 replies)
[–] starblursd@lemmy.zip 23 points 1 day ago

Or the more likely option that they get the cheaper ram from China and then double dip and use the ram scarcity excuse for higher prices

[–] Chivera@lemmy.world 24 points 1 day ago (1 children)

Can I load all of GTA 6 into RAM?

[–] Rai@lemmy.dbzer0.com 5 points 1 day ago

Making a RAM drive to load a few minutes of rolling video game footage so it isn’t constantly writing to my SSD or HDD was one of the most “the future is now” things I’ve done lately… and it’s not a new concept, I just never considered it before.

[–] AllNewTypeFace@leminal.space 19 points 1 day ago

Remortgage your house now.

[–] vegeta@lemmy.world 15 points 1 day ago (1 children)

Yeah, but can it run Crysis?

[–] ranzispa@mander.xyz 14 points 1 day ago (1 children)

Nope, still running single core. Probably runs worse than on older CPUs which were optimized for single core clock speed.

[–] boonhet@sopuli.xyz 9 points 1 day ago

IPC in modern CPUs is up compared to 2007 or whatever though

load more comments
view more: next ›