this post was submitted on 02 Aug 2026
43 points (100.0% liked)

Selfhosted

61126 readers
650 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world
43
Selfhosting Sunday! What's up? (lemmy.nocturnal.garden)
submitted 7 hours ago by tofu@lemmy.nocturnal.garden to c/selfhosted@lemmy.world
43 comments fedilink hide all child comments
 

It's been a while! Let us know what you're currently working on, what exploded, what cool stuff you found, or just brag that everything is running fine unattended.

I haven't been doing a lot, renovate auto upgrades for patches and sometimes minor updates work great so far. I got involved in my union to spin up a mastodon server soon, so there's a new project, but I already run mastodon so it shouldn't be much of a deal, I just need to get comfortable with the infrastructure. I also set up ntfy but only sent some test notifications and didn't configure any app yet - planned for Element Chat.

[Meta] I'm not sure how to apply the new tags. In the recent versions of this thread, people sometimes posted about their ollama setup or the like, but I'm not mentioning AI in the post body (except this meta thingy) and it shouldn't be much of the discussion, but it's an open post. Maybe curbstickle can chime in to let me know if I should apply one of them.

you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 1 points 1 hour ago* (last edited 1 hour ago)

First of all, I mean zero offense with any purchase decision. A 5090 is very good.

…But if I were paying that kind of money, I’d probably get a 4090 and a new motherboard/CPU instead. Maybe a used DRR4 threadripper system.

Hybrid (CPU + GPU) inference is where it’s at these days. It opens up a whole world of huge MoE models, whereas on an 5090 you are stuck with Qwen 27B.

Having a fast CPU, with lots of RAM channels, with full PCIe bandwidth is much more important for that than having a 5090, where a 3090 or 4090 will get the job done.

Even if pure speed is your primary concern, you can tune a sparse 120B model (like Laguna) to run almost as fast as Qwen 27B on a 5090, and get at-least-good results.

It’s more finicky and involved, though. For sure.

Running an LLM on a 5090 is a task. Hybrid CPU + GPU inference is a hobby.