What happens when a GPU reads memory

yipinwong an hour ago | parent | next [-]

This is a type of article that is HN worthy and came to HN for initially because I don't even understand a third of content there. Giving me inspiration to dive deeper.

SEriously, I don't understand it (yet) lol.

	▲	nazgulsenpai 17 minutes ago \| parent [-]
		That's the best feeling -- idly clicking through looking for that one rabbit hole to fall down then stumbling upon a gem like this. I noticed this the first time on copetti.org articles about game console architectures: know nothing, look every jargon or acronym up as you read along, end up with 42 tabs and a basic high-level understanding of the topic by the end.

▲

KellyCriterion 40 minutes ago | parent | prev | next [-]

VERY good article, reminds me on:

"what every programmer should know about memory" https://github.com/Ty-Chen/Reading-List/blob/master/What%20e...

▲

empiricus 2 hours ago | parent | prev | next [-]

For a long time, the chip manufacturers had an inclination to simplify the hardware and rely on the software adapting and optimizing. But for decades this bid failed. Now we have the unrelenting AI capable of finetuning kernels relatively quickly. Maybe simpler hw will work this time? Note: not sure if TPU/NPU is not only simple but also too limited.

▲

snigacookie 40 minutes ago | parent | prev | next [-]

Can someone help me understand why I spent 5 minutes reading something that I still don't understand?

Link for the ELI5 version?

▲

mathisfun123 26 minutes ago | parent | prev | next [-]

YMMV; not all GPUs work exactly like this

▲

brcmthrowaway an hour ago | parent | prev [-]

Ctrl+F PCIe BAR.. nothing.

▲

porridgeraisin an hour ago | parent [-]

This is talking about HBM/GDDR

	▲	KK7NIL an hour ago \| parent \| next [-]
		a.k.a. VRAM
	▲	brcmthrowaway an hour ago \| parent \| prev [-]
		Something needs to be transferred from sysmem right?