| ▲ | nozzlegear 2 hours ago | |
I've heard 27B is smarter! I tried it some time ago but couldn't get it working with my oMLX. I need to try it again. | ||
| ▲ | mattnewton an hour ago | parent | next [-] | |
Honestly the 27b dense one punches way above its weight in a lot of domains, especially coding in my testing, so I think you will probably be disappointed. | ||
| ▲ | npodbielski 26 minutes ago | parent | prev [-] | |
In my case I would say they are comparable but moe models are looping and getting lost a lot more than dense models. On the other hand having 90t/s with any local model is nice and Pi with loop police extension can prevent looping a lot. | ||