Remix.run Logo
▲ welferkj 4 days ago

You're comparing apples to oranges. 109 million tokens is ~nothing, easily a day's worth of casual use. Compare price per token and cloud providers are probably much closer. But even that isn't a fair comparison between cloud AI providers and abusing retailer return policies just yet, because usable local models even remotely comparable to the frontier don't fit in 16gb of vram.