Remix.run Logo
choldstare 2 days ago

Not really - on prem llm hosting is extremely labor and capital intensive

applfanboysbgon 2 days ago | parent [-]

But can be, and is, done. I work for a bootstrapped startup that hosts a DeepSeek v3 retrain on our own GPUs. We are highly profitable. We're certainly not the only ones in the space, as I'm personally aware of several other startups hosting their own GLM or DeepSeek models.

wuschel 2 days ago | parent [-]

Why a retrain? What are you using the model for?