| ▲ | bashtoni 2 hours ago | |||||||
No, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model. MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something. | ||||||||
| ▲ | Pragmata 2 hours ago | parent [-] | |||||||
I meant quantized. You can get an EXL3 quantized version thats almost the same performance. | ||||||||
| ||||||||