| ▲ | trollbridge 14 hours ago | |
For anyone reading this, GLM-5.2 is actually a lot more accessible than that on the 1 or 2 bit quantised models - see https://unsloth.ai/docs/models/glm-5.2 Basically a 1x 24GB GPU (32GB would be better) plus 256GB of free system RAM, or a 256GB unified memory machine (like a Mac). Kind of shocked they got the results they did. | ||