| ▲ | jbverschoor 2 hours ago | |
Not true for unified systems. And for strix halo you need to dedicate the amount which is annoying. You’re basically stating that swapping is also a bad idea. And to take it further, any memory or storage is a bad idea because there’s L1 cache/SRAM which is faster then the rest | ||
| ▲ | dataflow an hour ago | parent | next [-] | |
> You’re basically stating that swapping is also a bad idea. Is that a crazy thing to say? I can't recall the last time I was grateful for swap; it might've been before 2010. | ||
| ▲ | imtringued an hour ago | parent | prev [-] | |
It's not true for unified systems, because they have no secondary RAM that could be used to extend the GPU memory. It's pretty weird to insist on a counterargument that has no implications or consequences to the presented argument. Yes, swapping is a bad idea. Your second argument also falls flat, because the standard CUDA hardware setup doesn't use CXL so cache coherence isn't available. You're left with manual memory synchronization. Pretending that GPUs have cache for system RAM when they don't is pretty suspect. | ||