Remix.run Logo
amelius 4 hours ago

> > NVIDIA is one of the most open labs.

> Of course they are. They're commoditizing their complement

Then why don't they sell consumer GPUs with tons of memory. They clearly segment the market into consumer versus server/business.

pizza234 an hour ago | parent | next [-]

There are - see the RTX Pro 6000, which has 96 GB.

There are a few problems though, primarily, a GPU with lots of VRAM and very high bandwidth is inherently very expensive (on top of which there is also the CUDA premium); AI use cases are better served by SoCs with lower (but still high) bandwidth and more RAM.

HanClinto 3 hours ago | parent | prev [-]

The upcoming RTX Spark [0] is aiming to fill that space -- consumer GPUs with tons of memory.

[0] - https://www.nvidia.com/en-us/products/rtx-spark/

SuchAnonMuchWow 3 hours ago | parent [-]

This is not a GPU, this is a laptop SoC with CPU and integrated GPU, and knowing nvidia it will probably be even more closed than an intel CPU. You will own even less of your hardware

2 hours ago | parent [-]
[deleted]