> It is absolutely not worth buying hardware to run models for purely (long term) cost reasons

This is especially true when it's trivial to have the LLM itself write you a script/tool that can rent a GPU node for you (via API calls to providers) and then download and set up an open weight model for you.