| ▲ | johndough 5 hours ago | |
If you quantize GLM-5.2 to 4 bit, you can do it in less than 500GB: https://huggingface.co/unsloth/GLM-5.2-GGUF (table on the right)If you find three finds that also have a 128GB MacBook, you can chain them together (the MacBooks, not your friends) and make it work. You could also run GLM-5.2 on a single MacBook if you stream the active parameters from disk, but even with speculative decoding, you'd probably only get in the order of 1 token per second, so this is not really practical for most applications. | ||