Memory bandwidth is less than 300 GB/sec, looking at the data sheet. So it won't really be any faster at local inference than a Mac Pro or a decent x86 box.

It appears to be an embedded DGX Spark, at the end of the day.