Remix.run Logo
typpilol 10 hours ago

Ya a lot of ppl don't realize you could spend 2k on a 5090 to run some of the large models.

Or spend 20 a month for models even a 5090 couldn't run. And not have to spend your own electricity, hardware, maintenance, updates etc.

oytis 9 hours ago | parent [-]

20 a month for a commercial model is price dumping financed by investors. For ollama it's hopefully a sustainable price.

theshrike79 10 minutes ago | parent [-]

The 20 a month models definitely aren't sustainable.

This is why everyone needs to get every flavour and speedrun building all the tools they need when the infinite money faucets are turned off.

At some point companies will start raising prices or moving towards per-token pricing (Which is sustainable, but expensive).