Remix.run Logo
Remix clone Hacker News
new | show | ask | jobsGithub
▲ suprjami 5 hours ago

With an impressive 1.5TB/s RAM bandwidth you'd think they'd advertise that more.

Marketing department asleep at the wheel.

▲auspiv 4 hours ago | parent | next [-]

This is a very low number for a server GPU. My V100 from 2017 is 0.9 TB/s.

A single B300 has almost 8 TB/s.

AMD MI300x from 2023 is 5.3 TB/s

Edit: my bad you are saying that this is an impressive number precisely because it is more or less normal RAM, not VRAM

▲magicalhippo 22 minutes ago | parent | next [-]

And a 5090 has 1.79 TB/s.

So yeah on its own not very impressive.

The large amount of memory means you can serve larger models, or less quantized, but that also means they're going to be slower due to the low bandwidth.

https://www.techpowerup.com/gpu-specs/geforce-rtx-5090.c4216

▲pixelpoet 2 hours ago | parent | prev | next [-]

VRAM isn't a type of memory, it's just RAM used for the GPU. So this LPDDR5 is VRAM, just like it can be with my Strix Halo machine.

▲genxy 2 hours ago | parent | prev [-]

Its bandwidth is around that of 32 DDR5 DIMMS (50ish GB/s). These boards should have built in NICs but they don't because Intel also wants to sell more servers.

▲Aurornis an hour ago | parent | prev | next [-]

> Marketing department asleep at the wheel.

The marketing department doesn't have to lift a finger in this market. They could quietly drop it for sale without a single announcement and it would be backordered for a year.

▲layoric 5 hours ago | parent | prev | next [-]

Source? Extremely impressive if true

▲jagannathtech 3 hours ago | parent | prev [-]

These things will fly off the shelves with 0 marketing