Remix.run Logo
varispeed an hour ago

> that local models are good enough for whatever they're peddling

they are not. Unless you are satisfied with plausible, but mostly garbage output.

cogman10 an hour ago | parent | next [-]

They are actually quite a bit better than you might think. Qwen3.6 27B is pretty capable at coding.

For non-coding work, they are more than good enough. A lot of the ways my non-technical family members have interacted with AI would be perfectly served by using a local model.

After all, people were more than satisfied with the results from GPT 3. That has long since been surpassed by open weight models.

Matticus_Rex 10 minutes ago | parent [-]

I'm sure there are things local models are good enough at in non-coding work, but for anything complex I do not find this to be the case.

I'd say local models are fairly capable of even somewhat complex coding execution. For complex non-coding work (research, in-depth analysis, assembly of complex info-dense documents) I'd rather do it by hand than switch from Opus 4.7 to anything I could even theoretically run locally.

chadgpt3 4 minutes ago | parent | prev | next [-]

isn't that literally all output an LLM generates?

throw1234567891 34 minutes ago | parent | prev | next [-]

I get results comparable to the saas. Maybe Anthropic sold you too much crack tokens.

fluoridation an hour ago | parent | prev [-]

Honestly, that's the output I get from non-local models, anyway. If I'm going to get plausible nonsense either way, I may as well run it on my own hardware.