Not quite. They have 128GB of ram that can be allocated in the BIOS, up to 96GB to the GPU.

allocation is irrelevant. as an owner of one of these you can absolutely use the full 128GB (minus OS overhead) for inference workloads