Remix.run Logo
tomtheelder 18 hours ago

I think the question is even a bit more nuanced than that. Even if frontier models can maintain a big gap that gap has to actually _matter_. If a local model satisfies my everyday use cases adequately then I may not really care that a frontier model is 5, 10, 100x better at ultra high order reasoning tasks.

I think that reality is probably not all that far off for a huge swath of use cases.

geophile 17 hours ago | parent [-]

This is exactly the mainframe vs PC dynamic.

tomtheelder 17 hours ago | parent [-]

100%, I thought about writing that out explicitly. I really feel like we are extremely close to reaching that kind of breaking point for most folks LLM use cases.