Eh, I don’t know about that. With current Sonnet API pricing, an M5 Max w/ 128 GB can break even in a few months.

Qwen flash-next is at least as good as Sonnet for my uses, and the speed is perfectly acceptable.

I really think the big labs are going to soon start feeling pricing pressure for everything smaller than Opus-tier models, and it will come for those next.

▲

Gareth321 2 days ago | parent [-]

> Eh, I don’t know about that. With current Sonnet API pricing, an M5 Max w/ 128 GB can break even in a few months.

Only if you're comparing apples with oranges. There are no local LLMs at 128GB RAM which compete with Sonnet 5.5 intelligence. And the gap is a chasm when comparing against Opus 5.5, which is fast and cheap and plentiful on event he $20 subscription.

▲

dansquizsoft 2 days ago | parent [-]

Don’t say it too loud, I’m planning some arbitrage moves in the future based on what I consider is the absolute wrong vibe on here that thinks local llms are going to dominate in the near future

	▲	otabdeveloper4 2 days ago \| parent [-]
		> that thinks local llms are going to dominate in the near future People saying this actually know how to run local models. People claiming otherwise are Claude customers who know nothing beyond its point-and-click interface. Consider that fact.