Selfhosted

62234 readers

766 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Where to start with setting up my own server? (lemmy.dbzer0.com)

submitted 5 hours ago by cerebralhawks@lemmy.dbzer0.com to c/selfhosted@lemmy.world

21 comments fedilink hide all child comments

Good news selfhosted crowd! I pitched the idea of setting up a server, and she is down with the idea!

I want to run Linux and host things like Jellyfin, Audiobookshelf, Navidrome, maybe Plex (I currently host it off my Mac desktop but would move it to a dedicated server).

I know you can host Plex et al on something like a Raspberry Pi, but I want a bit more power. I want something that can push at least 2-3 4K streams.

I'm considering targeting 12th gen i5 with 16GB DDR4. Maybe 32GB if I can swing it. Is that overkill? I know you want 8th gen Intel for hardware transcoding of either x265/HEVC or AV1 (probably the former as the latter is newer).

There are other projects I'd like to run. I'd like to be able to host my own LLM/AI but I'm not trying to go performance overkill here. This would be my first server.

I am somewhat comfortable using the command line, and I would be remoting into the server via my Macs (I have a desktop and a MacBook). However, Linux can run Windows games via Proton and that's something I'm interested in for some older titles that aren't on Xbox (like Deus Ex, which came out in 2000 and should run on integrated graphics). I'm not inexperienced with Linux and have been using it off and on (mostly off unfortunately) for over 30 years. My go-to would be Ubuntu, but I've heard great things about KDE lately and I know the Internet is in love with Mint these days. Would the distro really matter all that much as long as I have the required services?

you are viewing a single comment's thread
view the rest of the comments

[–] undrwater@lemmy.world 1 points 4 hours ago (2 children)

You can run an LLM, but it will be limited. Look into Open Vino Model Server.

I'd recommend a minimal install distro (Ubuntu server, Arch, Gentoo, etc...), then add the things you need from there.

Document every step. <--- important

[–] Cyber@feddit.uk 4 points 2 hours ago

@cerebralhawks@lemmy.dbzer0.com this is the very important bit:

Document every step. <--- important

Whatever you do will make sense for about a day, you'll have a rough idea of what you did the following weekend, after that... all gone.

And, whatever you do won't be right first time, so you will be editing those notes - all part of the journey

[–] surewhynotlem@lemmy.world 1 points 2 hours ago (1 children)

Not llamacpp?

[–] undrwater@lemmy.world 1 points 13 minutes ago

OVMS + a model that was built for it is far more responsive than llamacpp.