Remix.run Logo
▲ lrvick a day ago

On a 16gb card check out Bonsai2. I run it on my 6800XT.

▲luxpir a day ago | parent [-]

Was pleasantly surprised to get 25-35tps on 3060, 12GB VRAM with Bonsai2. Quite smart, tool calls, vision, 95+% intelligence of dense qwen3.8 27b apparently.

Impressed with your setup @lrvick. Hoping Bonsai type improvements bring local inference to more modest setups. Still use frontier models for now, but very ready to stop.