| ▲ | simonw a day ago | |||||||
Tried again with a different quant, UD-Q2_K_XL: https://tools.simonwillison.net/markdown-svg-renderer#url=ht... | ||||||||
| ▲ | simonw a day ago | parent | next [-] | |||||||
... and once more with UD-IQ4_XS https://tools.simonwillison.net/markdown-svg-renderer#url=ht... | ||||||||
| ||||||||
| ▲ | potus_kushner a day ago | parent | prev [-] | |||||||
the xhigh version looks amazingly good for a 2 bit quant. | ||||||||