| ▲ | ashirviskas 2 days ago | ||||||||||||||||
> I've tried other very small models that run on CPU only and had better results Maybe you can you share some comparative examples? | |||||||||||||||||
| ▲ | nopelynopington 2 days ago | parent [-] | ||||||||||||||||
sure, here's my conversation with BitNet b1.58 2B4T here's the same prompt given to smollm2:135m The quality of the second results are not fantastic. The data isn't public, and it repeats itself mentioning income a few times. I don't think I would use either of these models for accurate data but I was surprised at the truncated results from bitnet Smollm2:360M returned better quality results, no repetition, but it did suggest things which didn't fit the brief exactly (public data given location only) Edit: I tried the same query on the live demo site and got much better results. Maybe something went wrong on my end? | |||||||||||||||||
| |||||||||||||||||