Remix.run Logo
▲ TSiege 5 hours ago

The response to Jev should be the nail in the coffin over whether or not the AI business is a commodity market.

Out of no where Jev appeared as the next round of the price wars. Jev showed the value of System One models. A fast yes/no/confidence score not only is cheaper but also often all people want. Open source versions flood hugging face and now the big players are giving up a potentially big driver of output tokens to keep customers and race to the bottom price wise.

If I were OpenAI or Anthropic I’d be racing to make their products as sticky as possible bc ppl will flock to what’s cheapest otherwise.

▲tripleee 4 hours ago | parent | next [-]

It takes me all of 2 keypresses to switch models. I don't know of a less sticky product

▲schleck8 3 hours ago | parent | next [-]

You've not seen how long it takes to switch an enterprise claude subscription to github copilot or vice versa with all the compliance and shareholders

▲skissane an hour ago | parent | next [-]

A lot of places already subscribe to both. Indeed, in large enterprises it isn’t uncommon to simultaneously subscribe to Copilot, Claude, OpenAI, Cursor, AWS Bedrock, Gemini, etc — you might subscribe to different ones for different teams/projects/employees/etc, but often the approval by legal/IT/etc is generic not scoped to whoever is using it right now

If you are charged based on usage, you can “soft switch” between them really quickly.

▲afavour an hour ago | parent | prev | next [-]

Comes to something then OpenAI’s best hope is to essentially become the next Oracle.

▲htrp 3 hours ago | parent | prev | next [-]

isn't that a problem for large enterprises?

▲mikestorrent 2 hours ago | parent | next [-]

It's a problem for the security, legal, and IT teams, but not that much for developers, unless they get really particular about their harness. On the other hand, these are the high dollar value accounts that providers want to keep; but if there's no reason to avoid switching, this market really will feel like a utility market (i.e. it'll be like switching ISPs or cell phone providers - annoying but fungible).

The AI companies want to differentiate and become something more than a commodity, even if it's as critical as a utility is.

▲judge2020 2 hours ago | parent | prev [-]

Enterprises tend to be your largest customers. Especially when current stock values for tech companies are majority predicated on AI becoming a staple in everyday life.

▲nimchimpsky an hour ago | parent | prev [-]

[dead]

▲johnfn 3 hours ago | parent | prev | next [-]

This implies you didn’t run any sort of evaluations? It is not realistic for any sort of production use case to do this.

▲shermantanktop 2 hours ago | parent [-]

Agree. Switching models with a keypress is for developer coding.

Jev and this decisions api are mostly useful for inference at scale in a workload where cost and latency matter… and that’s where evals become crucial. Could coding tools use it? Sure, but that’s probably a special case.

▲st3fan 4 hours ago | parent | prev [-]

If you are a business dealing with with anything remotely sensitive then this is not so easy and you are basically forced to do business with a big player.

▲gobdovan 5 hours ago | parent | prev | next [-]

> If I were OpenAI or Anthropic I’d be racing to make their products as sticky as possible bc ppl will flock to what’s cheapest otherwise.

Hopefully people will flock to whatever product is making its mission to be commodity and the easiest to replace. Really don't want another free ingress, 100$/TB egress Cloud situation.

▲ 4 hours ago | parent | prev | next [-]
[deleted]
▲draw_down 2 hours ago | parent | prev [-]

[dead]