I was thinking about migrating my services to self management k8s cluster, mostly for education purposes. I have some low traffic services running on one dedicated server on Scaleway now - there’s some nextcloud, portainer, hastebin (sort of pastebin) mysql database, personal wiki, couple of half-dead blogs, stuff like that. Nothing resources heavy, nothing that needs tight SLA. I plan to add a little of my own software anytime soon, but I don’t expect it to be very needy as well.
I’m planning on going with 3 nodes with min. 2 cores and 4 GB of RAM, and an additional service for storage. Does anyone here had experience with self hostes kubernetes? Do you have any advices? Do you think nodes like these are enough or I should upgrade (or downgrade)? Can you reccomend some providers that could offer this setup at low cost?
I’ve three rPi4 8Gb models running K3S with each node being both worker and control plane - works very well and I use keepalived and HAproxy to ensure the control plane remains available if any of the raspberry PIs need to reboot.
I’ve a Helios NAS running NFS for shared storage across all of the nodes.
It’s all reasonably low power but it has enough capacity to run a bunch of containers for media handling etcetera.
I used k3s and use the same node as master and runner. I started off with 3 nodes like you are planning, but soon discovered they for home use it just adds overhead in keeping up to date and backing up, and I had to find some way of doing persistent storage without standing up yet another VM as a NFS host, so downsized to a single node.