| ▲ | kzrdude 4 hours ago | |
Raw model size is around 27x2 GB since it's in BF16 format | ||
| ▲ | macwhisperer an hour ago | parent [-] | |
4-bit quant sits at 15.72GB | ||
| ▲ | kzrdude 4 hours ago | |
Raw model size is around 27x2 GB since it's in BF16 format | ||
| ▲ | macwhisperer an hour ago | parent [-] | |
4-bit quant sits at 15.72GB | ||