The Nvidia based one uses the memory for the GPU allowing you to run AI models on the GPU, the system you're talking about has no such setup. These are Nvidia powered laptops that do what Apple does with their laptops where the system and GPU VRAM are shared as needed, except the idea here is that Nvidia designed these to perform very well for local inference, at least, that's how I understand it.

▲

girvo 2 hours ago | parent [-]

No, the AMD ones he’s talking about allow the GPU to address that memory as well: they’re “APU’s” that share system RAM as GPU memory

That said the compute power of the GB10 is awesome, my DGX Spark-like has been better than I expected.

	▲	fy20 an hour ago \| parent \| next [-]
		Depending on what you are doing you may find all the models are written for CUDA though. I'm playing with gaussian splatting and it's like that. Codex is doing a good job porting stuff to Metal, but it would be easier & faster if I had Nvidia hardware to just run the models natively. Not everything with AI is LLMs running on llama.cpp.
	▲	giancarlostoro an hour ago \| parent \| prev [-]
		That's the thing, my understanding is that these Nvidia ones are supposed to have very impressive performance.