| ▲ | Majromax 3 hours ago | |
> As things settle down and commoditize, the value of switching on a dime diminishes as people lock into their favorite models I can imagine just the opposite outcome from the same scenario: as people settle into their favorite but commoditized models, competition for marginal inference cost will take over. A company like OpenRouter that promises the cheapest tokens by the minute becomes essential on the low-cost margin. I think that OpenRouter and equivalents get pushed out of the market only if the froth calms down (as you posit) and winning models stay proprietary, perhaps with their own unique API surfaces. | ||
| ▲ | drob518 an hour ago | parent [-] | |
> A company like OpenRouter that promises the cheapest tokens by the minute becomes essential on the low-cost margin. Okay, I can see that, but if their value is just cost optimization, their ability to mark up the tokens becomes increasingly difficult as well. Or, people will build a router themselves to avoid paying the markup, possibly with reduced features, but someone will open source it. Heck, Claude or GPT can probably one-shot it these days. Either way, I think the whole OpenRouter model is going to struggle unless the market stays frothy. | ||