| ▲ | SwellJoe 5 hours ago | |
"sufficient resources" is going to be a lot of resources. I doubt this will run on even something like a Strix Halo or DGX Spark, even at 1-bit quantization. You'll need a 256GB or 512GB Mac Studio, or a monster GPU situation, to run it locally, I think, though quantized versions aren't showing up yet, to be sure. | ||
| ▲ | 4 hours ago | parent [-] | |
| [deleted] | ||