this post was submitted on 24 Jun 2026
63 points (78.4% liked)

Selfhosted

60093 readers
876 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam.

  3. Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.

  4. Don't duplicate the full text of your blog or git here. Just post the link for folks to click.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require your active participation in selfhosting or related communities, or the post will be removed. No more than 10% of your posts or comments may be self-promotional, or your post will be removed. F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, your post is exempt from this rule as long as you continue to engage in comments.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[–] frongt@lemmy.zip 28 points 10 hours ago (2 children)

Yes. Openwebui/ollama for LLM, comfyui for stable diffusion. I just dick around with it as a toy.

[–] Shimitar@downonthestreet.eu 1 points 4 hours ago

I was put off by ComfyUI, seems awfully complex. How is your experience?

Any suggestions to start? I have Fooocus installed now

[–] mesamunefire@piefed.social 9 points 10 hours ago* (last edited 10 hours ago) (1 children)

Same. Its somewhat useful on some very small scripting or tasks...but its mostly just to try out a new model or two. Its not really useful for anything big.

I will have to say....even my tiny models are about as good as Chatgpt/Claude/etc... which makes me think about how much people are spending on tokens regularly. I was able to get the same kind of python script started with my local tiny model that was comparable to the newest Claude code offerings.

[–] Lettuceeatlettuce@lemmy.ml 4 points 9 hours ago (1 children)

What local models have you been using? And what hardware are you running them on? I've been playing with local LLMs a bit for exactly your use case.

I have zero interest in vibe coding or full agentic workflows. But having a local LLM generate a Bash script to help me automate parts of my home lab infrastructure would be nice.

[–] Die4Ever@retrolemmy.com 1 points 5 hours ago (1 children)

What are your hardware specs?

[–] Lettuceeatlettuce@lemmy.ml 0 points 5 hours ago

Ryzen 7 5800 X3D Radeon RX 9070XT 32GB of DDR4 system memory.