Remix.run Logo
▲ mediaman 3 hours ago

These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).

In this case there is huge demand from companies who consume API tokens at currently high prices who do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.

The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.

▲danudey an hour ago | parent | next [-]

> which failed because of network effects

Not to nitpick, but Windows Phone also failed because Microsoft released the first generation of devices with Windows Phone 7, convinced a bunch of people to buy them, and then released a second generation of devices with updated Windows Phone 8, a version that the first generation couldn't upgrade to meaning that anyone who got in on the ground floor got locked out immediately.

When you go out of your way* to screw the people most interested in your new product it doesn't really engender large amounts of trust in what would have been your second wave of customers.

* Well, to be specific, WP8 was based off of the NT kernel and WP7 was based off of the WinCE kernel so it was probably 'the right choice' on some level, but making the entire first generation of a new product line EOL immediately rather than making an effort to ensure those people get... something... is still a dick move.

▲arkensaw an hour ago | parent | next [-]

yeah they should have had a trade in program, that would have bought them serious brownie points all around.

But Windows Phone history is a long list of things they should have done

▲toast0 38 minutes ago | parent | prev [-]

WP7 -> WP8 was rough (as was WM6.5 -> WP7), but WP8 -> WM10 was worse... while you could upgrade WP8 devices to WM10, IMHO, it wasn't worth it. Better to support old and new until the old ones age out. IIRC, WP8 had a big spec jump (single -> dual core, ram requirements, etc), so an upgrade probably wouldn't have worked...

The final build of WM10 was actually not awful... too bad it came 2 years after launch. :P

People talking about network effects killing windows phone probably don't know about how well WP8 sold low end phones in developing markets. Of course, WM10 abandoned that part of the market ... just another thing Microsoft could have done differently. :P

▲danielmarkbruce 2 hours ago | parent | prev | next [-]

100% this. Lots of people want cheaper. The demand for same performance but cheaper is off the charts.

▲danudey an hour ago | parent | next [-]

Agree. I was talking to a coworker the other day and remarked that I would be pretty content if we had five years of Claude stagnating in quality/capability but reducing in price/environmental/electrical impact.

It reminds me of when Apple switched to their own silicon in the iPhones and we had year after year of hardware with 1.5-2.5x performance compared to the previous year. We very rapidly got to the point where the processor in my phone was more power than I would ever need (unless apps got more and more bloated and inefficient, which they obviously did).

▲Ampersander 2 hours ago | parent | prev | next [-]

The performance is really fuzzy too, but the price you do know for certain.

▲mcintyre1994 2 hours ago | parent [-]

Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started.

▲seizethecheese an hour ago | parent [-]

> a model that's more token efficient but more expensive per token can be cheaper for a given task.

True, but I'm skeptical that this is now overly used to ignore cost per token. Your comment inspired me to do a quick investigation. Looks like in my data, 92% of cost per task can be predicted by cost per token https://micjm.com/blog/cost-per-task-vs-token/

▲danielmarkbruce an hour ago | parent [-]

Definitely. Cost per task is nice in theory, pretty absurd in practice.

▲seizethecheese 42 minutes ago | parent [-]

Well, it depends on the data source. Cost per task for benchmarks is absurd. Cost per task for real world usage, where the model identity is randomized (Like Arena or Agent Duel) seems better, though the tasks still are not going to be representative if you're not doing the same stuff as the battle participants.

▲santoshalper 2 hours ago | parent | prev [-]

Or even 90% of the performance but much cheaper. Many business tasks to not require frontier intelligence and were solvable two years ago.

▲adventured 2 hours ago | parent [-]

Yeah if you're talking 85-90% of the performance at 10-15% the cost, you're going to win most of the business use cases over. That has been the broad theoretical appeal of the Chinese models, that they might provide that kind of value. Most businesses could not care less about open weights vs not, that does not enter into their discussions very heavily. They care about cost to performance. Fable 5.2 is amazing, and it's as good at eating dollars as it is at producing code.

▲dofm 2 hours ago | parent | prev | next [-]

> These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).

FWIW it is worth noting that the GP's suggestion is more in line with Microsoft's own stated belief in the future of "unmetered AI".

At the moment, Microsoft is arguably meeting that claim with their support for and encouragement of Nvidia Nemotron Bolt, which is an actually pretty good, quite interesting, unusually-trained-and-sized-to-fit MoE model that was designed to go with the launch of the Nvidia/Microsoft RTX Spark machines.

(Good Sam Witteveen video about it: https://www.youtube.com/watch?v=WJpeW9lCSUM )

But it would be good to see Microsoft themselves distilling an open weights model.

Like any vendor with a profit motive they do have to decide the obvious, though: how do you make money from it, when right now it could cost several hundred million dollars to train (even if you adjust the training of a larger proprietary model so you can distill the smaller one from it)?

There is, essentially, no way to keep an open weights model from being copied/distilled/extracted, and IMO what that tends to suggest is that open weights models will essentially gravitate to sort of uncontroversial, "standard library" tasks.

So I think it also means that Microsoft's approach on open weights will ultimately be the same as Apple's: they will focus their efforts on LLMs that meaningfully add function to their OS and can be decapitated to make similarly useful decision models.

Put another way: given the geopolitical angle of the last few weeks, I think it is possible that the open weights coding models we have now may be among the best we will ever get, until the nearly inevitable GPU/tensor hardware glut arrives.

In the meantime, something else is clearly happening: much broader competition in the "good enough" models category, which is what we need to drive down the cost of inference hardware such that open source and open weights are feasible over the longer term.

▲pianopatrick an hour ago | parent | next [-]

Long term I think the economics point to having a "Linux of AI". I.e. Operating systems were the same way, expensive to make but everyone needed one and did not want to pay for one. So maybe many of the big corporations will eventually collaborate on one ecosystem of open weight models where they share the costs of training it. Then they can compete on other things like serving it or whatever.

▲alala-lala-lon an hour ago | parent | prev [-]

[dead]

▲jrmg 34 minutes ago | parent | prev | next [-]

Cheaper per token when used via the API.

How do they compare with the fuzzily-priced only-our-agent cheap tokens you get on a Claude Pro or Max plan?

▲mapontosevenths 2 hours ago | parent | prev | next [-]

> The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.

Fun fact - Enterprises are just big groups of people.

If none of your people have ever used a tool because it's expensive, locked away in a some walled garden, and obscure then none of the enterprises will have demand for it. Management might force them to use some cheap model, but users will all be pushing for the models with mindshare, and Microsoft will lose marketshare as a consequence.

Apple knew this when they put Apple IIe's in schools. It's still paying dividends. Today, Anthropic and OpenAI know it and are actively hemorrhaging money trying to become synonymous with AI. Microsoft seems to think that this is all a race to the bottom. I think they're wrong.

▲TeMPOraL 2 hours ago | parent [-]

FWIW, the frontier labs have like zero barrier to entry, even for general population. In contrast, open weight models require technical expertise to run (and/or paying third parties that host them, which requires researching and tracking which ones work and are trustworthy - i.e. hassle). So you're right in theory, but that argument evaluates strongly in favor of labs & current MS approach, and strongly against open weight.

▲worik an hour ago | parent [-]

Plenty of Open Weight models available from API providers.

There is a lot of choice...

▲Keyframe 2 hours ago | parent | prev | next [-]

ho do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.

one is not true, the other is not all that relevant considering disparity in pricing local vs API even subsidized.

Even if both were true, this is Microsoft. There's negative chance of them producing anything close to frontier anytime soon or at all. They've been absent altogether and relied on others; The little they did is not even in also ran category like grok is for example.

▲mcmcmc 2 hours ago | parent [-]

The point is you no longer need frontier models to get “good enough” AI, and MS is offering a marginal improvement over open-source models at very good value

▲kuboble 28 minutes ago | parent | next [-]

I know at least one company where people are forced to use coding agents via microsoft contract, and their monthly quotas for developers are limited to an equivalent of at best couple days of Opus 5.5.

they will happily use a microsoft model that is slightly less capable at fraction of the cost.

▲Keyframe an hour ago | parent | prev [-]

that'd make sense

▲InsidiousWombat an hour ago | parent | prev [-]

I'm seeing MS code quality in their products. 90% cheaper isn't worth it