| ▲ | mordae 2 days ago | |
They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these. | ||
| ▲ | namegulf 2 days ago | parent [-] | |
That's right, need a lot of GPUs + memory, anybody experimented with Mac Studio M3 Ultra for this? | ||