Remix.run Logo
sarchertech 2 hours ago

No we have no idea that the open source inference market isn’t being kept artificially low because some of the operators are operating a loss hoping to gain market share. All it takes is a few and everyone else has to lower prices to compete while they hope for lower costs and subsidies to dry up.

We also have to assume that these operators are correctly pricing GPU depreciation, and the market is so new there is no reason to believe they are.