this post was submitted on 24 Jun 2026
140 points (81.2% liked)

Selfhosted

62069 readers
465 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] fizzle@quokk.au 1 points 2 months ago (1 children)

The short answer is no.

I have played around with ollama and whisper. It's just too slow to be practical. The cost of the hardware is preclusive.

That said, I do selfhost openwebui and use inference end points from huggingface and ovh.

I've never used chatgpt or claude and I have to wonder whether those alternatives are really as terrible as the models available on huggingface. The output is always super plausible but usually just plain wrong.

[โ€“] SuspiciousCarrot78@aussie.zone -2 points 2 months ago* (last edited 2 months ago)

They're not. Call them via API on Open Router and see for yourself.

There's a reason OAI and Anthropic are considered best in class and it's not just hype.