GPUs could explode to multiple TB with new storage-inspired memory tech

ashdnazg 14 hours ago | parent | next [-]

Maybe Optane was just a few years too early. There's finally a demand for a middle ground between RAM and SSD.

mft_ 16 hours ago | parent | prev | next [-]

I’d be okay with only 1.6 TB/s bandwidth in my affordable 512GB GPU. Gotta start somewhere.

ksec 14 hours ago | parent | prev | next [-]

You will literally have to have a specific HBF controller on the GPU which I doubt would be any smaller than current state of the art SSD controller.

I am not entirely sure it is a Win Win situation.

▲

aitchnyu 12 hours ago | parent | prev | next [-]

I was expecting memristors, fast as RAM and persistent. They used to make strong headlines before the GenAI age.

	▲	jacquesm 9 hours ago \| parent [-]
		Bubble memory, memristors, there are a lot of technologies that seemed promising but somehow never made it to mass production. https://en.wikipedia.org/wiki/Bubble_memory fascinating stuff, even today.

▲

Bender 17 hours ago | parent | prev [-]

The technology, called high-bandwidth flash (HBF), is being developed by Sandisk and SK Hynix and aims to provide SSD-like capacities at HBM-like speeds.

Persistent storage in a video card? As soon as advertisers can write to this I would expect "bad things to happen"(c). Will the end users have the ability to access and clean this storage like a regular disk prior to any corporations being able to write into it?

▲

jacquesm 17 hours ago | parent [-]

Presumably, yes. It essentially boils down to a high capacity flash drive that is just used to store weights with a fast path to the GPU. It's interesting because I had this same idea last week and had been doing some tests and then this Register article rolls around and it is pretty much in the pipeline. Oh well, one day I'll have an original idea.

▲

phyalow 13 hours ago | parent [-]

Story of my life. One day something novel will fall out of the ether and not decay rapidly.

	▲	jacquesm 11 hours ago \| parent [-]
		Keep trying :) Rooting for you. Though with the current pace of innovation in this particular field it is really a tough time.