| ▲ | asaddhamani an hour ago | |
QAT models are trained to quantize well? I don’t get the concern here. | ||
| ▲ | woadwarrior01 an hour ago | parent [-] | |
Please read their blog post. This isn't a run of the mill QAT post trained model (like Gemma 4 QAT). It was natively trained in NVFP4, through and through. > Most of Inkling 2 Mini’s weights were trained and are deployed natively in NVFP4, with the last four layers in MXFP8. | ||