... I was thinking about buying a 96GB DDR5 kit from the local computer store a few weeks ago, but wasn't sure it was actually worth €700. Checked again now and the exact same product costs €1500. I guess that settles it, 32GB will have to be enough for the next couple of years then.
fhein
joined 2 years ago
So far that has never happened because I'm not using that much storage :) But I shut it down when I need to turn off the mains electricity, and for powering it on afterwards the fake wall can be lifted off. It's just the area underneath the desk so the panel might be smaller than it sounds like, and it hangs on some hooks so it's fairly easy to remove if you know what you're doing. Painted in the same colour as the wall, and with some some random junk on the floor in front, it blends in quite well though. I think the risk of burglary is fairly low, so it's primarily to soothe my own paranoia.
I mounted mine on the wall under a desk in a room with no other electronics, and then put up a fake wall in front of the server. It can draw in air from the sides, and exhaust upwards behind the desk. But the only real solution is offsite backup, which will also protect against fire and other disasters.
I just wanted to test if it was viable to run larger MoE LLMs on CPU, e.g. Qwen3-next-80B-A3B.. Even if I got acceptable generation speeds I'd probably get bored with it after a few hours, as with other local models. Had I got it for €700 it was pretty low value for money anyway, since my current RAM is enough for everything else I use the computer for. On the positive side, I can put that money towards a Steam Frame instead.