I’m curious: are you spending on beefy developer machines, or some kind of shared local inference server? Would be interested to know more if it’s the latter.

I am aware of at least a handful of companies doing the latter. I don’t work for them and cannot speak to their setup.