People keep saying this and idk what I'm doing wrong. Using q8_0 on all the latest and greatest local models and they just don't come close to sonnet.

I've tried different harnesses, building my own etc.

They are reasonably close to haiku? Maybe?

You're not doing anything wrong, they are not comparable.

Claims to the tune of "this 0.5B local model running on my phone is almost as good as [large expensive model]" are common but greatly exaggerated, it's simply not true beyond the most basic use cases.

Only the much larger models (such as the 744B GLM-5) manage to come close, but nobody's running those locally.