| ▲ | abalashov 2 hours ago | |
Not a ton. I'd say 64 GB minimal to play, 96-128 GB better. | ||
| ▲ | throwawayffffas 2 hours ago | parent [-] | |
Nah, you can run the 24b - 35b class with between 90k and 256k of context with about 40GB and they are pretty good. Especially the MOE variants fit neatly in 40GB. | ||