>getting us off of commercial LLM

sounds fun, I had fun fine-tuning some open weights models for local use, and I run a free public inference engine here: https://stateofutopia.com/services/ai/ it's fun.

where are you planning to run your models?