| ▲ | walrus01 2 hours ago | |
the 'unsloth' link above is a 3rd party person that has quantized it to Q8, the original release is considerably larger in size than 600GB: | ||
| ▲ | zozbot234 2 hours ago | parent [-] | |
That page mentions that the model is natively INT4 for most of the params, and 600GB is in the ballpark of what's available there for download. | ||