| ▲ | iandanforth 5 hours ago | |
FWIW scaling up from https://huggingface.co/avlp12/Qwen3.8-27B-Alis-MLX-6bit and some other sources: You might expect the M5 Ultra to produce 50 t/s from Qwen 3.8 27B with a good context length. | ||
| ▲ | iandanforth 5 hours ago | |
FWIW scaling up from https://huggingface.co/avlp12/Qwen3.8-27B-Alis-MLX-6bit and some other sources: You might expect the M5 Ultra to produce 50 t/s from Qwen 3.8 27B with a good context length. | ||