| ▲ | wolvoleo 40 minutes ago | |||||||
Exactly. It seems to not really be a permanent gap but more a time gap. Locally you're about a year or so behind SOTA. Is that terrible? Not really, a year ago cloud model users were raving about what they had. There's some things like knowledge breadth that really need a huge model but those things can be compensated for with web lookups (which is preferable for source validation and currency anyway) | ||||||||
| ▲ | kakugawa 29 minutes ago | parent | next [-] | |||||||
Yeah, a good balance would be a local reasoning model paired w/ a knowledge pack + web-based searches. You want your obscure coding language? Provide a pre-vetted knowledge pack locally that it knows how to use. Same with any other domain-specific knowledge. | ||||||||
| ||||||||
| ▲ | InsideOutSanta 23 minutes ago | parent | prev | next [-] | |||||||
> Locally you're about a year or so behind SOTA If that holds, I'll be able to do 99% of my work with local models around March 2027. | ||||||||
| ▲ | furyofantares 29 minutes ago | parent | prev [-] | |||||||
Would local models catch up if frontier models paused new training for a year? I'm not sure for. It might just be you can get these nice local models because of distillation from a much more powerful model. | ||||||||
| ||||||||