The easiest thing to do (takes 5 minutes) is to use LMStudio and then search for the model inside LMStudios UI.

It will show you on the model selection IF a model fits and if you use a "Qwen 3.8-35B-A3B" type of model, it should just work out of the box. A3B stands for Active which means you need a lot less fast ram.

You will run into issues fast though: If you have big tasks for it to do, your pc/mac will get warm very fast and noisy and you will cosume relevant more energy.

And as you mention: yeah small context!

Its still not that practical in my opinion.

I have been trying to setup LMstudio for hours and the model downloads always fail. Looks like my vpn is blocked somehow/somewhere :/