| ▲ | smcleod a month ago | |
That's impressive getting a 397B down to <110GB~. HF link is broken though! | ||
| ▲ | tarruda 25 days ago | parent [-] | |
> That's impressive getting a 397B down to <110GB It is higher than 110GB. MacOS allows up to 125G of the RAM to be shared with GPU, so it is certainly less than that! > HF link is broken though! Doesn't seem broken to me, but you should be able to search for tarruda/Qwen3.5-397B-A17B-GGUF on huggingface. | ||