Models keep on improving though, so doesn't fine tuning become an ongoing task with ongoing maintenance burden?

(one of the blog post authors here) -> once you set up a finetuning pipeline, it's often trivial to rerun it on top of a new open weights model. so, it's orthogonal to base model improvements