| ▲ | noduerme 2 hours ago | |
What's the story with Mac laptops? Worth a try? | ||
| ▲ | cyberrock 43 minutes ago | parent | next [-] | |
Dense ones like this are more bandwidth-hungry, so you want to try MoE ones like Qwen3.6-35B-A3B (35 Billion params but only 3 Billion Active) or Gemma 4. Unfortunately it seems like we might not be getting a 3.8 MoE. | ||
| ▲ | selcuka 2 hours ago | parent | prev | next [-] | |
The author tested in on an M5 laptop too: > It feels pretty slow on both the M5 Mac and the DGX Spark. | ||
| ▲ | rawland 2 hours ago | parent | prev [-] | |
Yes. mtplx runs it at 25 tok/sec on a M4 Max with 48GB RAM. | ||