Remix.run Logo
nine_k 4 days ago

Does it offer more performance than a Macbook Pro that could be had for a comparable sum? Your build can be had for under $3k; a used MBP M3 with 64 GB RAM can be had for approximately $3.5k.

btbuildem 4 days ago | parent | next [-]

I'm not sure, I did not run any benchmarks. As a ballpark figure -- with both cards throttled down to 250W, running a Qwen-30B FP8 model (variant depending on task), I get upwards of 60 tok/sec. It feels on par with the premium models, tbh.

Of course this is in a single-user environment, with vLLM keeping the model warm.

bee_rider 4 days ago | parent | prev [-]

MacBooks have some clever chips, but 2x 3090 is a lot of brawn to overcome.