| ▲ | Tepix 5 hours ago | |||||||
I’m wondering myself: Do bigger models suffer less from quantization? Are there papers? | ||||||||
| ▲ | ricardobeat 5 hours ago | parent [-] | |||||||
They seem to degrade a lot less. You don't need papers, good quants are usually published with benchmark data, for example: https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-... which maintains parity with FP8 even at 2 bit. | ||||||||
| ||||||||