Point taken but there isnt any western providers there yet. Power is cheaper in china.

These models are open and there are tons of western providers offering it at comparable rates.

NitpickLawyer 2 days ago | parent | prev | next [-]

As this is a new arch with tons of optimisations, it'll take some time for inference engines to support it properly, and we'll see more 3rd party providers offer it. Once that settles we'll have a median price for an optimised 1.6T model, and can "guesstimate" from there what the big labs can reasonably serve for the same price. But yeah, it's been said for a while that big labs are ok on API costs. The only unknown is if subscriptions were profitable or not. They've all been reducing the limits lately it seems.

	▲	ithkuil 2 days ago \| parent [-]
		Is there evidence that frontier models at anthropic, openai or google or whatnot are not using comparable optimizations to draw down their coats and that their markup is just higher because they can?

▲

persedes 2 days ago | parent | prev [-]

not soooo much though. It's heavily subsidized for residential consumption, but industrial power rates are almost comparable to the US (depends on the state you go to etc).