| ▲ | dgellow 10 days ago | |
You’re way better to run your own on premise models. Laptops are depreciating assets, do not benefit from economy of scale, have fixed specs, result in a fragmented fleet where you need to keep models up to date. Without talking about power consumption and cooling issues. I really don’t see why companies would go that direction | ||
| ▲ | bluGill 10 days ago | parent | next [-] | |
You don't need to run on laptops, desktops plugged into mains power get more power consumption and better cooling. I want my laptop to work, but I can accept when I'm on an airplane at 32k feet I get less abilities. | ||
| ▲ | 9 days ago | parent | prev | next [-] | |
| [deleted] | ||
| ▲ | CharlieDigital 10 days ago | parent | prev [-] | |
Even if the laptop costs $5k and you upgrade it every year with the latest hardware and run local models (assuming your workload can tolerate smaller models at slower tok/s), you win. | ||