This is a very low number for a server GPU. My V100 from 2017 is 0.9 TB/s.

A single B300 has almost 8 TB/s.

AMD MI300x from 2023 is 5.3 TB/s

Edit: my bad you are saying that this is an impressive number precisely because it is more or less normal RAM, not VRAM

And a 5090 has 1.79 TB/s.

So yeah on its own not very impressive.

The large amount of memory means you can serve larger models, or less quantized, but that also means they're going to be slower due to the low bandwidth.

https://www.techpowerup.com/gpu-specs/geforce-rtx-5090.c4216

VRAM isn't a type of memory, it's just RAM used for the GPU. So this LPDDR5 is VRAM, just like it can be with my Strix Halo machine.

Its bandwidth is around that of 32 DDR5 DIMMS (50ish GB/s). These boards should have built in NICs but they don't because Intel also wants to sell more servers.