| ▲ | moojacob 3 hours ago |
| I was a fan of coheres general purpose LLM. Command A I think? Before they came out with their reasoning model. More competition is better. |
|
| ▲ | SubiculumCode 3 hours ago | parent [-] |
| I always forget the VRAM requirements on these MOE things |
| |
| ▲ | sipjca 2 hours ago | parent [-] | | fwiw because of the relatively few activated params offloading to system RAM is quite feasible, you can see the endless amount of people doing this on r/localllama with qwen3.6 35a3b | | |
| ▲ | bitwize 7 minutes ago | parent [-] | | I ran Gemma4 26B A4B on an 8yo PC with a fucking GTX and it did rather well. |
|
|
