| ▲ | nine_k 4 days ago | |
Does it offer more performance than a Macbook Pro that could be had for a comparable sum? Your build can be had for under $3k; a used MBP M3 with 64 GB RAM can be had for approximately $3.5k. | ||
| ▲ | btbuildem 4 days ago | parent | next [-] | |
I'm not sure, I did not run any benchmarks. As a ballpark figure -- with both cards throttled down to 250W, running a Qwen-30B FP8 model (variant depending on task), I get upwards of 60 tok/sec. It feels on par with the premium models, tbh. Of course this is in a single-user environment, with vLLM keeping the model warm. | ||
| ▲ | bee_rider 4 days ago | parent | prev [-] | |
MacBooks have some clever chips, but 2x 3090 is a lot of brawn to overcome. | ||