I'm increasingly thinking the same as our spend on tokens goes up.

If you have HPC or Supercompute already, you have much of the expertise on staff already to expand models locally, and between Apple Silicon and Exo there are some amazingly solutions out there.

Now, if only the rumors about Exo expanding to Nvidia are true..