this post was submitted on 03 Jun 2026
964 points (99.7% liked)

People Twitter

10414 readers
394 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a pic of the tweet or similar. No direct links to the tweet.
  4. No international politcs
  5. Be excellent to each other.
  6. Provide an archived link to the tweet (or similar) being shown if it's a major celebrity, figure or any politician. See stickied post https://web.archive.org/save is an option. Archive.is is no longer recommended because they remove/alter content.
  7. If a tweet (or similar) makes a statement of fact, either mark it as "satire" in the body or provide the original source link backing up the statement (see rule 6)

founded 3 years ago
MODERATORS
964
Managers (media.piefed.zip)
submitted 3 months ago* (last edited 3 months ago) by inari@piefed.zip to c/whitepeopletwitter@sh.itjust.works
 
you are viewing a single comment's thread
view the rest of the comments
[–] Jiral@lemmy.org 1 points 3 months ago* (last edited 3 months ago) (1 children)

Yes I think Strix Halo makes sense when low power use is a requirement. I built a custom fanless Strix Halo system for the fun of it and I guess there aren't too many out there running Gemma 4 31B Q8 without a single fan, anywhere.

And for MoE models that need 60-80GB + context it is perfect. Those are decently fast then as well.

PS: If VRAM is all you care about the maxed out Mac Studio is fascinating. 512GB unified memory for around 10K EUR (pre crazy bubble prices) That should be able to run pretty large MoE models but dense models of that size would probably run glacially.

[–] lime@feddit.nu 1 points 3 months ago (1 children)

i'm not buying any hardware for the forseeable future :P it's all just wishful thinking at the moment. but unified memory architectureis probably going to become more common so maybe in five years when some new motherboard standard becomes the norm...

[–] Jiral@lemmy.org 1 points 3 months ago* (last edited 3 months ago)

I fully understand. ;) Buying hardware now means you'd be either crazy or desperate.