|
| ▲ | Someone1234 34 minutes ago | parent | next [-] |
| Not hard; just initially expensive (hardware mostly). While I'm also a huge fan of local LLMs and believe they will be key in the future; I think the claim of "just as good" is hyperbole. They're productively useful tools though, and something worth exploration. |
| |
| ▲ | binary0010 30 minutes ago | parent [-] | | Well GLM-5.1 is 744billion params, no way I can run that locally. I use the opencode Go or Zen subscription. They have a zero day retention policy for all the model providers which is nice.
And then I can still use little local models like qwen and stuff by just swapping over to them. But GLM is SOTA level for code, so it's obviously going to beat all local small models by a lot. |
|
|
| ▲ | binary0010 37 minutes ago | parent | prev [-] |
| Extremely easy. Download opencode GUI or cli.
Sign up for Go or Zen plan, choose GLM-5.1 model. |
| |
| ▲ | hootz 33 minutes ago | parent [-] | | And you don't even have to use the OpenCode CLI, their subscription works with Pi, Charm and other harnesses. This is the way. If they screw up everything, I can drop their sub and go somewhere else. |
|
