| ▲ | Aurornis 6 hours ago | |
> I understand why the AI people want it to help with the latency between the CPU and GPU. The reason AI users like it is because it provides a large amount of higher-bandwidth memory at a price much lower than an equivalent GPU. If you had 16GB of DDR5 in a normal 2-channel consumer board it would not be this fast. This gives 16GB of high speed memory for a very low price compared to a full GPU. The larger unified memory systems like Strix Halo or Apple Silicon provide access to high bandwidth memory at scales you can’t get with any consumer GPU. > But having people in some cases use it as for marketing is kinda like getting watered down beer and getting told its a good thing because alcohol is bad for you I don’t think you understand the benefits of having high speed memory attached at a low price point. Yes we would all prefer to have the same amount of even faster memory attached to a dedicated GPU, but that’s not happening at this price point. Better analogy would be that this is an entry-level sports car for the price of a Honda Civic but you’re complaining that it’s not a Lamborghini. | ||
| ▲ | Dylan16807 2 hours ago | parent [-] | |
> The reason AI users like it is because it provides a large amount of higher-bandwidth memory at a price much lower than an equivalent GPU. But unified memory isn't providing high bandwidth. Apple's specific implementation on pro or higher chips does. There's a zillion desktops and laptops running unified memory at low to medium-low speeds, and the baseline M series is part of that with its 128 bit bus. Most unified memory devices are handicapped because of the unification, not boosted. Yet people keep praising unified memory. | ||