| ▲ | amelius 4 hours ago | ||||||||||||||||
> > NVIDIA is one of the most open labs. > Of course they are. They're commoditizing their complement Then why don't they sell consumer GPUs with tons of memory. They clearly segment the market into consumer versus server/business. | |||||||||||||||||
| ▲ | pizza234 an hour ago | parent | next [-] | ||||||||||||||||
There are - see the RTX Pro 6000, which has 96 GB. There are a few problems though, primarily, a GPU with lots of VRAM and very high bandwidth is inherently very expensive (on top of which there is also the CUDA premium); AI use cases are better served by SoCs with lower (but still high) bandwidth and more RAM. | |||||||||||||||||
| ▲ | HanClinto 3 hours ago | parent | prev [-] | ||||||||||||||||
The upcoming RTX Spark [0] is aiming to fill that space -- consumer GPUs with tons of memory. | |||||||||||||||||
| |||||||||||||||||