> Why should these developers rebuild a core piece of their stack every few months?

That's what they signed up for when established a hard dependency on an subscription online-only LLM model.