| ▲ | lrvick a day ago | |
On a 16gb card check out Bonsai2. I run it on my 6800XT. | ||
| ▲ | luxpir a day ago | parent [-] | |
Was pleasantly surprised to get 25-35tps on 3060, 12GB VRAM with Bonsai2. Quite smart, tool calls, vision, 95+% intelligence of dense qwen3.8 27b apparently. Impressed with your setup @lrvick. Hoping Bonsai type improvements bring local inference to more modest setups. Still use frontier models for now, but very ready to stop. | ||