Doesn't the 3090 cap out at 24GB VRAM? That's not a lot to run a local model

but still it can run handsome models

Latest MBP goes up to 128GB of memory.

	▲	bigyabai 17 hours ago \| parent [-]
		The M5 Max's GPU is slower than a single RTX 3090, though. Both machines will be stuck in the 30-50GB model range, but the 3090 would have faster token prefill and faster decode speeds (614GB/s on M5 Max vs 936GB/s on 1x 3090).