You're not doing anything wrong, they are not comparable.

Claims to the tune of "this 0.5B local model running on my phone is almost as good as [large expensive model]" are common but greatly exaggerated, it's simply not true beyond the most basic use cases.

Only the much larger models (such as the 744B GLM-5) manage to come close, but nobody's running those locally.