| ▲ | drdaeman an hour ago | |||||||
Rather than waiting, ask your assistant to quantize for you. It could be not the best quantization possible but it’s relatively quick, and I had an overall positive experience. | ||||||||
| ▲ | smallerize 36 minutes ago | parent [-] | |||||||
It is already quantized. You need to convert to GGUF format though. Did your assistant explain this wrong? | ||||||||
| ||||||||