| ▲ | vanviegen 4 hours ago | |
> In the long term, I think models are going to be local-first. Why? There's an inherent efficiency advantage to scale, while the only real advantage for local models (privacy/secrecy) hasn't proven convincing for broader IT either. | ||
| ▲ | solid_fuel 2 hours ago | parent | next [-] | |
Local first models aren't just more private than the API vendors, they also have the advantages of fixed cost, lower latency, and better stability - local models don't get nerfed/"updated" in the background like chatgpt does. Maybe in a world where these AI companies behaved with some semblance of ethics and user-friendliness they would be on even ground, but for anyone paying attention local models are obviously the future. | ||
| ▲ | LtWorf 2 hours ago | parent | prev [-] | |
To not depend on an external company that can decide the price. | ||