Remix.run Logo
▲ kennywinker an hour ago

The claimed 20% the cost suggests that the models are 20% the size. Which means these models are flying in the face of an orthodoxy that says the only way to make a model better at coding is to make it better at everything. I think this coming year is when we'll see that orthodoxy fall, as people realize you can make a model better at coding by making it better at coding.

▲Wheen 43 minutes ago | parent | next [-]

DeepSeek v4.1 1017 and Qwen 3.8-Flash already proved that, IMO.

It also points to a major issue with Artificial Analysis, which weighs knowledge recall heavily (30% of the engineering index and 45% of the general intelligence index, splitting HLE-Diamond in half for its knowledge questions). DSv4.1F can handle all my work faster than Fable, but Fable is supposedly twice as "intelligent" in both the general intelligence index and the engineering index primarily because DS is a fraction of the size and fails on trivia questions (which, in practice, can be shored up by a harness with web search).

▲origini an hour ago | parent | prev | next [-]

Or architectual optimizations for inferencing or optimized inferencing or MS is paying the bill to gain market shares.

One thing big models are def better at is holding more complex abstractions in context and I do find better results.

▲ac29 an hour ago | parent [-]

> or MS is paying the bill to gain market shares.

Yeah, Anthropic has a huge gross margin on inference per their S1, there's no reason to believe Microsoft couldn't offer better pricing even if the model is as large/cost as much to host

▲hugmynutus 44 minutes ago | parent | prev [-]

> Which means these models are flying in the face of an orthodoxy that says the only way to make a model better at coding is to make it better at everything.

Fair amount of research has already shown this isn't the case. The latest example is -> https://arxiv.org/html/2610.18868v1

Post training a model for a specific task can give a non-trivial boost when done correctly.