Remix.run Logo
esseph 11 hours ago

Try it on bare metal where you're managing the distributed storage and the hardware and the network and the upgrades too :)

JohnMakin 10 hours ago | parent | next [-]

Why would you want to do that though?

On cloud, in my experience, you are mostly paying for compute with managed kubernetes instances. The overhead and price is almost never kubernetes itself, but the compute and storage you are provisioning, which, thanks to the control plane, you have complete control over. what am i missing?

I wouldn’t dare try to with a small shop try to self host a production kubernetes solution unless i was under duress. But I just dont see what the control plane has to do with it. It’s the feature that makes kubernetes worth it.

LelouBil 3 hours ago | parent | next [-]

I am in the process of redoing all of my self-hosting (cloud storage, sso, media server, and a lot more), which previously was a bunch of docker compose files deployed by Ansible. This quickly became unmanageable.

Now I almost finished the setting up part using a single-node (for now) Kubernetes cluster running with Talos Linux, and all of the manifest files managed with Cue lang (seriously, I would have abandoned it if I had not discovered Cue to generate and type check all of the yaml).

I think Kubernetes is the right solution for the complexity of what I'm running, but even though it was a hassle to manage the storage, the backups, the auth, the networking and so on, I much prefer having all of this hosted at my house.

But I agree with the control plane part, just pointing out my use case for self-hosting k8s

esseph 4 hours ago | parent | prev [-]

May need low latency, may have several large data warehouses different workloads need to connect to, etc.

Regulated industries, transportation and logistics companies, critical industries, etc.

lillecarl 10 hours ago | parent | prev [-]

Tinkerbell / MetalKube, ClusterAPI, Rook, Cilium?

A control plane makes controlling machines easier, that's the point of a control plane.

esseph 4 hours ago | parent [-]

I'm not debating the control plane, I'm responding to the question about "are people running it themselves in production?” (non-managed on-prem infra)

It can be challenging. Lots and lots of knobs.