| ▲ | geerlingguy a day ago | |
Kiki K2 was made to be optimized at 4-bit, though. | ||
| ▲ | natrys a day ago | parent [-] | |
That's the Kimi K2 Thinking, this post seems to be talking about original Kimi K2 Instruct though, I don't think INT4 QAT (quantization aware training) version was released for this. | ||