this post was submitted on 07 Sep 2026
523 points (97.3% liked)

Technology

87897 readers
4542 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 3 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
523
Nobody Will Say Why Every Major AI Chatbot Suddenly Went Down Yesterday (futurism.com)
submitted 1 day ago by GolfFoxtrotLima@sh.itjust.works to c/technology@lemmy.world
122 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Damage@feddit.it 2 points 2 hours ago (1 children)

Well it works anyway even with a bit of occupied vram, but you could also buy a cheap videocard to use as an output. I have small intel card like that in my server for jellyfin transcoding, I think I paid 60€ for it, it hardly uses any power

[–] isVeryLoud@lemmy.ca 1 points 1 hour ago* (last edited 1 hour ago) (1 children)

I actually did exactly that previously! I had both an RX 6800 XT and an RX 6600 in my system and I used the 6600 for video output. Unfortunately, this cuts my RX 6800 XT from PCIe 4 16x to PCIe 4 8x and severely slows down model loading for llama-swap. Joys of the X570!

And yes, I do have it running right now with a bit of occupied VRAM, but I need to limit my model to 14 GB to leave 2 GB free for GNOME Shell. I really want one of those 64 GB UMA Mac Mini, I heard they work really well because the GPU has direct access to system RAM.

[–] Damage@feddit.it 2 points 1 hour ago (1 children)

So I have a framework laptop with ryzen ai cpu that uses 48gb of shared ram, and it does run Q4 llms fine enough, but I'm not sure it compares to a real GPU.

On my desktop I have an RX 7900 XTX but I've only dabbled in image generation so far, so right now I couldn't really tell you the difference.

[–] isVeryLoud@lemmy.ca 1 points 57 minutes ago

24 GB VRAM. Damn, jealous! My 16 GB seems pitiful in comparison 😅

I do wonder if the Ryzen AI CPUs compare with Apple's UMA. I'm mostly interested in LLM inference for code generation and automation.