| ▲ | Aurornis 2 hours ago | |
I’ve debated Mac Studio or MBP at each generation. For equal spec machines the price premium to get a MBP over the Studio is always smaller than I expected, so I pay the extra amount and get the MBP. This changes when you get into connotations that aren’t available in the laptop form factor, but with RAM prices the way they are those configurations are more than I want to spend on a local machine right now. For running local LLMs the high memory Mac options always look appealing, but the processing speed (prefill) is so much slower than GPUs that it hurts. For situations where you have no rush and can let something work in the background for 24 hours it can some times be ignored, but the speeds I get from a real GPU setup are so much faster that I never use the larger models on a high memory Mac any more. | ||