Remix.run Logo
dist-epoch 3 hours ago

No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached.

dd8601fn 2 hours ago | parent [-]

It’s not even a sensible comparison.

You run way better models, whatever is newest, for the five years it takes for the “spark cluster” to even reach cost parity with far worse performance.

Those things aren’t spectacular at inference… it’s not really why you drop that kind of money on them.

18 minutes ago | parent [-]
[deleted]