Dual 3090 >>> Any Apple product.

kylec a day ago | parent | next [-]

Doesn't the 3090 cap out at 24GB VRAM? That's not a lot to run a local model

but still it can run handsome models

Latest MBP goes up to 128GB of memory.

	▲	bigyabai 17 hours ago \| parent [-]
		The M5 Max's GPU is slower than a single RTX 3090, though. Both machines will be stuck in the 30-50GB model range, but the 3090 would have faster token prefill and faster decode speeds (614GB/s on M5 Max vs 936GB/s on 1x 3090).

gnabgib a day ago | parent | prev [-]

> Dual 3090 >>> Any Apple product.

Dual 3090s are terrible airpods

	▲	tim-tday a day ago \| parent [-]
		I snorted