| ▲ | teaearlgraycold 35 minutes ago | |
I'm also hoping someone puts out a competitive 30-70B model soon. There's this massive dead zone between 24GB and <100GB of VRAM where it seems your best option is Qwen 3.8 27B. | ||
| ▲ | shockembopper 30 minutes ago | parent [-] | |
There are many engines that alleviate this issue in particular. The current mood is running qwen flash next using strata, basalt, ect. | ||