Remix.run Logo
gruez 3 days ago

But nobody really pays the 3x (ie. api) rates, except for enterprises. Everyone else are using the consumption plans, which are heavily discounted[1], possibly cheaper than even the chinese models, which don't do consumption plan discounts. Even in your linked reddit thread, the OP agreed with this sentiment.

[1] https://x.com/SemiAnalysis_/status/2064815044085318040

fragmede 3 days ago | parent | next [-]

Psh. Enterprises. There can't be more than a couple of them out there.

charcircuit 3 days ago | parent | prev | next [-]

I have paid API rates. I needed AI to cleanup file space and I didn't want to gamble with the alignment of Chinese models.

bdcravens 3 days ago | parent | prev | next [-]

There are many consuming APIs for Hermes.

applfanboysbgon 3 days ago | parent | prev [-]

For now. We've seen this pattern play out literally a hundred times in tech and you're incredibly naive if you think this will last forever. And what is your point? It should be okay for US consumers if the US government illegalizes accessing open-weight models within their borders because they're currently getting a subsidized token rate?