| ▲ | fenaer 2 hours ago | |
I was immediately hoping for some local-AI setups that do real work, on limited resources. Unfortunately it looks like this is still waiting on more people to share. | ||
| ▲ | gentile 23 minutes ago | parent [-] | |
Not a SWE, but I do Freetoken (backend) + unsloth (front) to run qwen 3.6 35B A3B NVFP4 (~20GB) in 8GB VRAM + ~20GB RAM. Getting around 50 t/s on a 3070. I don't think I can even share through this site. | ||