Remix.run Logo
vkazanov 7 hours ago

It is interesting how apple claimed that "unified memory" is something special, and ppl believed them.

Intel and AMD had been doing this for years already, and had linux support for it from day 1.

throw1234567891 7 hours ago | parent [-]

Cool. Apple was the only one who managed to ship a consumer device with UMA and RDMA support. 2TB VRAM max over RDMA.

vkazanov 5 hours ago | parent [-]

I think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus.

Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.

Not sure what RDMA brings to the table.

throw1234567891 4 hours ago | parent [-]

RDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.