Remix.run Logo
fred_is_fred a day ago

I've used k8s before a lot and at several companies. I am convinced that 99.9% of the people who use it should not be. But it's more fun than deploying VM images at least.

SlavikCA a day ago | parent | next [-]

I'm running k3s at home on single node with local storage. Few blogs, forum, minIO.

Very easy, reliable.

Without k3s I would have use Docker, but k3s really adds important features: easier to manage network, more declarative configuration, bundled Traefik...

So, I'm convinced that quite a few people can happily and efficiently use k8s.

In the past I used other k8s distro (Harvester) which was much more complicated to use and fragile to maintain.

esseph a day ago | parent [-]

Check out Talos Linux if you haven't already, it's pretty cool (if you want k8s).

SlavikCA 18 hours ago | parent | next [-]

I tried Talos few month ago. Found it unstable and complicated; reported few bugs.

And because they are "immutable" - I found it's significantly more complicated to use with no tangible benefits. I do not want to learn and deal declarative machine configs, learn how to create custom images with GPU drivers...

Quite a few things which I get done on Ubuntu / Debian under 60 seconds - takes me half an hour to figure out with Talos.

esseph 11 hours ago | parent [-]

Learning new things takes time.

It sounds like an immutable kubernetes distro doesn't solve any problems for you.

mkesper a day ago | parent | prev [-]

How do you manage node settings k8s does not yet handle with Talos?

fenaer a day ago | parent [-]

Talos has it's own API that you interact with primarily through the talosctl command line. You apply a declarative machineconfig.yaml with which custom settings can be set per-node if you wish.

kachapopopow a day ago | parent | prev | next [-]

I use k3s for my home and for dev envs I think it's completely fine especially when it comes to deployment documentation.

I am way more comfortable managing a system that is k3s rather than something that is still using tmux that gets wiped every reboot.

Well... it's what I would have said until bitnami pulled the rug and pretty much ruined the entire ecosystem as now you don't have a way to pull something that you know is trusted with similar configuration and all from a single repository which makes deployments a pain in the ass.

However, on the plus side I've just been creating my own every time I need one with the help of claude using bitnami as reference and honestly it doesn't take that much more time and keeping them up to date is relatively easy as well with ci automations.

yupyupyups a day ago | parent | next [-]

The situation with bitnami is getting fixed, but it takes time for all the holes to be plugged.

I knew bitnami were trouble when I saw their paid tier prices. Relevant article: https://devoriales.com/post/402/from-free-to-fee-how-broadco...

Oh, and it's owned by Broadcom.

Imustaskforhelp a day ago | parent | prev [-]

> I am way more comfortable managing a system that is k3s rather than something that is still using tmux that gets wiped every reboot.

Thoughts on Tmux-resurrect[1] , it can even resurrect programs running inside of it as well. It feels like it can as such reduce complexity from something like k3s back to tmux. What are your thoughts on it?

[1]:https://github.com/tmux-plugins/tmux-resurrect?tab=readme-ov...

kachapopopow a day ago | parent [-]

I had it break enough times to where I just don't bother.

udev4096 2 hours ago | parent | next [-]

Skill issue. It works just fine

Imustaskforhelp a day ago | parent | prev [-]

Well firstly I would love to know more about your workflow where it actually broke etc. because I feel like tmux-ressurect team could help or something for sure.

I haven't used the tool itself so I am curious as I was thinking of a similar workflow as well sometime ago

Now please answer the above questions but also I am going to assume that you are right about tmux-ressurect, even then there are other ways of doing the same thing as well.

https://www.baeldung.com/linux/process-save-restore

This mentions either Criu if you want a process to persist after a shutdown, or the shutdown utility's flags if you want to temporarily do it.

I have played around with Criu and docker, docker can even use criu with things like docker checkpoint and I have played with that as well (I used it to shutdown mid compression of a large file and recontinue compression exactly from where I left)

What are your thoughts on using criu+docker/criu + termux, I think that it itself might be an easier thing than k3s for your workflow.

Plus, I have seen some people mention vps where they are running the processes for 300 days or even more without a single shutdown iirc and I feel like modern VPS providers are insanely good at uptime, even more so than sometimes cloud providers.

kachapopopow 4 hours ago | parent [-]

failure scales exponentially with servers due to design limitations

even using tmux resurrect on my personal machine I've had it fail to resurrect anything

again - lack of documentation and loosy tmux resurrect state is not what I want to go thru when working in unfamilar environments

why are you getting downvoted

docker compose also has issues but at least it is defined, again if you are managing 10+ machines docker becomes a challenge to maintain especially when you have 4 to 5 clusters, when you are familiar with kubernetes there's virtually no difference between docker tmux or raw k8s, although I heavily recommend k3s due to its ability to maintain itself.

pjmlp a day ago | parent | prev | next [-]

Same here, I went through a few projects since 2021 where doing Kubernetes setups were part of my role on the consulting project, and I would say prefer managed containers solutions, e.g. Azure Web Apps, or when running locally plain systemd or Docker Compose.

Anything else, most companies aren't Web scale enough to set their full Kubernetes clusters with failover regions from scratch.

Gabrys1 a day ago | parent [-]

I like Docker(compose) + Portainer for small deployments

Chilinot a day ago | parent | prev [-]

What makes you come to that conclusion?

cyberpunk a day ago | parent [-]

They’ve never worked on a real soa/multi-team/microservices project with more than 20 separate deployments before and assumes no one else does.

fragmede 20 hours ago | parent [-]

20? That's still on the small end.