| ▲ | _aavaa_ 5 hours ago | |
For an fp4 quantization it should fit with room to spare for KVCache | ||
| ▲ | Tepix 4 minutes ago | parent [-] | |
Aren't Macbooks limited to 128GB RAM? FP4 would require >350GB RAM + KV cache, so no. | ||
| ▲ | _aavaa_ 5 hours ago | |
For an fp4 quantization it should fit with room to spare for KVCache | ||
| ▲ | Tepix 4 minutes ago | parent [-] | |
Aren't Macbooks limited to 128GB RAM? FP4 would require >350GB RAM + KV cache, so no. | ||