I run a local LLM on my gaming computer thats like a decade old now with an old 1070ti 8GB VRAM card. It does a good job running mistral small 22B at 3t/s which I think is pretty good. But any tech enthusiast into LLMs look at those numbers and probably wonder how I can stand such a slow token speed. I look at their multi card data center racks with 5x 4090s and wonder how the hell they can afford it.
Not anymore. My main self-hosting server is an i7 5960x with 32GB of ECC RAM, RTX 4060, 1TB SATA SSD, and 6x6TB 7200RPM drives.
I did used to host some services on like a $5 or $10 a month VPS, and then eventually a $40 a month dedi, though.
What do you use the 4060 for?
Yeah, not here either. I’m now at a point where I keep wanting to replace my last host thats limited to 16GB. All the others - at least the ones I care about RAM on - all support 64GB or more now.
64GB would be a nice amount of memory to have. I’ve been okay with 32GB so far thankfully.
My home server runs on an old desktop PC, bought at a discounter. But as we have bought several identical ones, we have both parts to upgrade them (RAM!) as well as organ donors for everything else.
Enterprise level hardware costs a lot, is noisy and needs a dedicated server room, old laptops cost nothing.
I’m still interested in Self-Hosting but I actually tried getting into self-hosting a year or so ago. I bought a s***** desktop computer from Walmart, and installed window server 2020 on it to try to practice on that.
Thought I could use it to put some bullet points on my resume, and maybe get into self hosting later with next cloud. I ended up not fully following through because I felt like I needed to first buy new editions of the server administration and network infrastructure textbooks I had learned from a decade prior, before I could continue with giving it an FQDN, setting it up as a primary DNS Server, or pointing it at one, and etc.
So it was only accessible on my LAN, because I was afraid of making it a remotely accessible server unless I knew I had good firewall rules, and had set up the primary DNS server correctly, and ultimately just never finished setting it up. The most ever accomplished was getting it working as a file server for personal storage, and creating local accounts with usernames and passwords for both myself and my mom, whom I was living with at the time. It could authenticate remote access through our local Wi-Fi, but I never got further.
It’s not absolutely shit, it’s a Thinkpad t440s with an i7 and 8gigs of RAM and a completely broken trackpad that I ordered to use as a PC when my desktop wasn’t working in 2018. Started with a bare server OS then quickly realized the value of virtualization and deployed Proxmox on it in 2019. Have been using it as a modest little server ever since. But I realize it’s now 10 years old. And it might be my server for another 5 years, or more if it can manage it.
In the host OS I tweaked some value to ensure the battery never charges over 80%. And while I don’t know exactly how much electricity it consumes on idle, I believe it’s not too much. Works great for what I want. The most significant issue is some error message that I can’t remember the text of that would pop up, I think related to the NIC. I guess Linux and the NIC in this laptop have/had some kind of mutual misunderstanding.
Solid. My backup is a T440p, and behind that a X230, fucking bulletproof.
Yeah, absolutely. Same here, I find used laptops often make GREAT homelab systems, and ones with broken screens/mice/keyboards can be even better since you can get them CHEAP and still fully use them.
I have 4 doing various things including one acting as my “desktop” down in the homelab. But they’re between 4 and 14 years old and do a great job for what they’re used for.
I used to selfhost on a core 2 duo thinkpad R60i. It had a broken fan so I had to hide it into a storage room otherwise it would wake up people from sleep during the night making weird noises. It was pretty damn slow. Even opening proxmox UI in the remotely took time. KrISS feed worked pretty well tho.
I have since upgraded to… well, nothing. The fan is KO now and the laptop won’t boot. It’s a shame because not having access to radicale is making my life more difficult than it should be. I use CalDAV from disroot.org but it would be nice to share a calendar with my family too.
I started my self hosting journey on a Dell all-in-one PC with 4 GB RAM, 500 GB hard drive, and Intel Pentium, running Proxmox, Nextcloud, and I think Home Assistant. I upgraded it eventually, now I’m on a build with Ryzen 3600, 32 GB RAM, 2 TB SSD, and 4x4 TB HDD
My first server was a single-core Pentium - maybe even 486 - desktop I got from university surplus. That started a train of upgrading my server to the old desktop every 5-or-so years, which meant the server was typically 5-10 years old. The last system was pretty power-hungry, though, so the latest upgrade was an N100/16 GB/120 GB system SSD.
I have hopes that the N100 will last 10 years, but I’m at the point where it wouldn’t be awful to add a low-cost, low-power computer to my tech upgrade cycle. Old hardware is definitely a great way to start a self-hosting journey.
Plex server is running on my old Threadripper 1950X. Thing has been a champ. Due to rebuild it since I’ve got newer hardware to cycle into it but been dragging my heels on it. Not looking forward to it.
My NAS is on an embedded Xeon that at this point is close to a decade old and one of my proxmox boxes is on an Intel 6500t. I’m not really running anything on any really low spec machines anymore, though earlyish in the pandemic I was running boinc with the Open Pandemics project on 4 raspberry pis.
4 gigs of RAM is enough to host many singular projects - your own backup server or VPN for instance. It’s only if you want to do many things simultaneously that things get slow.
My first @home server was an old defective iMac G3 but it did the job (and then died for good) A while back, I got a RP3 and then a small thin client with some small AMD CPU. They (barely) got the job done.
I replaced them with an HP EliteDesk G2 micro with a i5-6500T. I don’t know what to do with the extra power.
What are you running on it?
Prosody (XMPP server), a git instance, a searXNG instance, Tandoor (recipe manager), Next Cloud, Syncthing for my phone and my partner’s (one could say Next Cloud should be enough but I use it for different purposes), and a few other stuff.
It doesn’t even use an eight of its total RAM and I’ve never seen the CPU go past 20℅. But it uses a lot less power than the thin client it replaced so not a bad investment, especially considering its price.
How do you like searxng and have you considered hosting openstreetmaps?
Searxng is very good, I like it a lot. As for OSM, I didn’t even know it could be hosted.
All my stuff is running on a 6-year-old Synology D918+ that has a Celeron J3455 (4-core 1.5 GHz) but upgraded to 16 GB RAM.
Funny enough my router is far more powerful, it’s a Core i3-8100T, but I was picking out of the ThinkCentre Tiny options and was paranoid about the performance needed on a 10 Gbit internet connection
kind of… a “AMD GX-420GI SOC: quad-core APU” the one with no L3 Cache, in an Thin Client and 8Gb Ram. old Laptop ssd for Storage (128GB) Nextcloud is usable but not fast.
edit: the Best thing: its 100% Fanless
Odd, I have a Celeron J3455 which according to Intel only supports 8GB, yet I run it with 16 GB
Same here in a Synology DS918+. It seems like the official Intel support numbers can be a bit pessimistic (maybe the higher density sticks/chips just didn’t exist back when the chip was certified?)
