| ▲ | nullpoint420 13 hours ago | ||||||||||||||||||||||||||||||||||
100%. I’m really not sure why K8S has become the complexity boogeyman. I’ve seen CDK apps or docker compose files that are way more difficult to understand than the equivalent K8S manifests. | |||||||||||||||||||||||||||||||||||
| ▲ | this_user 8 hours ago | parent | next [-] | ||||||||||||||||||||||||||||||||||
Docker Compose is simple: You have a Compose file that just needs Docker (or Podman). With k8s you write a bunch of manifests that are 70% repetitive boilerplate. But actually, there is something you need that cannot be achieved with pure manifest, so you reach for Kustomize. But Kustomize actually doesn't do what you want, so you need to convert the entire thing to Helm. You also still need to spin up your k8s cluster, which itself consists of half a dozen pods just so you have something where you can run your service. Oh, you wanted your service to be accessible from outside the cluster? Well, you need to install an ingress controller in your cluster. Oh BTW, the nginx ingress controller is now deprecated, so you have to choose from a handful of alternatives, all of which have certain advantages and disadvantages, and none of which are ideal for all situations. Have fun choosing. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
| ▲ | everforward 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||
It's not the manifests so much as the mountain of infra underlying it. k8s is an amazing abstraction over dynamic infra resources, but if your infra is fairly static then you're introducing a lot of infra complexity for not a ton of gain. The network is complicated by the overlay network, so "normal" troubleshooting tools aren't super helpful. Storage is complicated by k8s wanting to fling pods around so you need networked storage (or to pin the pods, which removes almost all of k8s' value). Databases are annoying on k8s without networked storage, so you usually run them outside the cluster and now you have to manage bare metal and k8s resources. The manifests are largely fine, outside of some of the more abnormal resources like setting up the nginx ingress with certs. | |||||||||||||||||||||||||||||||||||
| ▲ | esseph 11 hours ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||
Managing hundreds or thousands of containers across hundreds or thousands of k8s nodes has a lot of operational challenges. Especially in-house on bare metal. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||