If you have enough system RAM (64GB), you can run Qwen 3.8 Flash Next with a GPU as small as 12GB, this repo is pretty amazing:

https://github.com/Niko1221/Strata/

My setup is a Ryzen 3600, 90GB DDR4 allocated to a VM (don’t even really need that much, just had it available, special thanks to the year 2024), and an RX 9060XT 16GB ($500 GPU).

I get around 40-60 tok/s depending on the quantization level I choose.

As you can see, the CPU is nothing special, don’t even need DDR5.