| ▲ | jmuguy 3 hours ago | |
Haha well I ask because I don't really want/need anything beyond Opus most of the time. And I'm paranoid that Anthropic is going to be forced to charge the true cost of all this before too long. | ||
| ▲ | Greenpants 3 hours ago | parent [-] | |
The other upside of running local LLMs is that there's no cloud provider to suddenly charge more for the same, or even less, model use. It's personal, but I prefer CapEx over OpEx for this. If you can purchase a device upfront that runs a decent local LLM, you get the peace of mind that your setup won't suddenly change over time and can only get better. | ||