this post was submitted on 24 Jun 2026
65 points (78.3% liked)

Selfhosted

60093 readers
773 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam.

  3. Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.

  4. Don't duplicate the full text of your blog or git here. Just post the link for folks to click.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require your active participation in selfhosting or related communities, or the post will be removed. No more than 10% of your posts or comments may be self-promotional, or your post will be removed. F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, your post is exempt from this rule as long as you continue to engage in comments.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] rando@lemmy.ml 1 points 6 hours ago (1 children)

Bought b70 with egpu enclosure and usb4 connection wasn't really planning to actually run anything but now ended up with llama.cpp with openwebui - kids/parents want to/have to use chat, might as well provide local solution than them using industry options. Also started with ollama and Gemma 4 26b a4b - asked it to write script to setup llama.cpp in container.

[โ€“] SuspiciousCarrot78@aussie.zone 1 points 2 hours ago* (last edited 2 hours ago)

Yeah, I've heard the B70 is good bang for buck. My kids love using chat GPT to generate images and I'm aware that there are some really capable local models that can do that as well now - B70 should make short work of it.

That may be something for me to look at later on if I decide to keep self hosting.

OTOH, I'm also aware that I may end up building something that they don't actually use. Been there, done that, and I don't want to do it again.

Actually, on that topic, one interesting use case for me is my youngest one wants to have a YouTube channel.

So obviously, I'm not going to let her become a YouTuber, but what I'm thinking of doing is providing her my old phone (properly locked down) so that she can video record clips that she wants.

Then, have those clips sent automatically to our jellyfin server so it appears like a channel. Code a fake YT plugin so that AI can do likes, positive comments etc.

It's... work. I dunno...maybe a good enough AI can vibe slop the entire project for me.