| ▲ | Greenpants 3 hours ago | |
The other upside of running local LLMs is that there's no cloud provider to suddenly charge more for the same, or even less, model use. It's personal, but I prefer CapEx over OpEx for this. If you can purchase a device upfront that runs a decent local LLM, you get the peace of mind that your setup won't suddenly change over time and can only get better. | ||