| ▲ | sottol 3 hours ago | |
Thanks! Qwen-3.8 27B seems to benchmark better but I'd like to try this some time. | ||
| ▲ | verdverm an hour ago | parent [-] | |
little qwen is my favorite for the homelab, vllm 0.28 now supports the dflash2 to go with it | ||
| ▲ | sottol 3 hours ago | |
Thanks! Qwen-3.8 27B seems to benchmark better but I'd like to try this some time. | ||
| ▲ | verdverm an hour ago | parent [-] | |
little qwen is my favorite for the homelab, vllm 0.28 now supports the dflash2 to go with it | ||