Selfhosted

60911 readers

1084 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Self-hosted voice assistant with mobile app (lemmy.world)

submitted 5 months ago by eager_eagle@lemmy.world to c/selfhosted@lemmy.world

32 comments fedilink hide all child comments

Any experiences with a self-hosted assistant like the modern Google Assistant? Looking for something LLM-powered that is smarter than older assistants that would just try to call 3rd party tools directly and miss or misunderstand requests half of the time.

I'd like integration with a mobile app to use it from the phone and while driving. I see Home Assistant has an Android Auto integration. Has anyone used this, or another similar option? Any blatant limitations?

you are viewing a single comment's thread
view the rest of the comments

[–] lyralycan@sh.itjust.works 5 points 5 months ago* (last edited 5 months ago) (1 children)

I don't think there's a straightforward way like a HACS integration yet, but you can access Ollama from the web with open-webui and save the page to your homepage:

Just be warned, you'll need a lot of resources depending on which model you choose and its parameter count (4B, 7B etc) -- Gemma3 4B uses around 3GB storage, 0.5GB RAM and 4GB of VRAM to respond. It's a compromise as I can't get replacement RAM, and tends to be wildly inaccurate with large responses. The one I'd rather use, Dolphin-Mixtral 22B, takes 80GB storage and 17GB min RAM, the latter of which I can't afford to take from my other services.

[–] excursion22@piefed.ca 14 points 5 months ago* (last edited 5 months ago) (2 children)

There's an Ollama integration that adds it as a conversation agent.

[–] hendrik@palaver.p3x.de 5 points 5 months ago* (last edited 5 months ago) (1 children)

And there's another custom component, integrating all servers with an OpenAI-compatible API endpoint: https://github.com/jekalmin/extended_openai_conversation

[–] wildbus8979@sh.itjust.works 5 points 5 months ago

Also https://github.com/acon96/home-llm/blob/90c0edc0907e4567eeca89a6f89b43c0b0b807eb/docs/Setup.md

[–] eager_eagle@lemmy.world 5 points 5 months ago

ah, this puts it together and it's exactly what I was looking for, thanks