| ▲ | kentm 2 hours ago | |
What are you using to host Qwen Flash Next right now? | ||
| ▲ | atomicnumber3 30 minutes ago | parent [-] | |
Unsloth studio, on a server that I built in 2024 that was, at the time, ludicrously oversized, but is now just ok-sized to run the q4 quant of qwen flash next. (128GB ram, 16GB vram). I really want to build something less scuffed, but, yknow. So I'm making do atm. | ||