this post was submitted on 05 Jun 2026
14 points (85.0% liked)
Fuck AI
7069 readers
2748 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Cool, thanks for the info. When I saw the memory bandwidth for the integrated systems like these, I thought perhaps it wouldn't be worth it over a custom build with a couple of 5090s (2.5x the price before the memory price hike). What models have you thrown at it? What's your tokens/second? The local-sized models keep getting more capable.
My potato 2060 plus 64GB of system RAM is enough to crawl along with some of the MoE models, but I've got projects that need way more compute (would like to content filter my torrent crawler database, finetune of one of the small Qwens to produce my novel programming language, ML experiments that currently take days/weeks to iterate, etc). Maybe an integrated system like yours is worth it after all.