Wow: notably a more advanced CPU than DGX GB200! 14 Neoverse V3AE cores, where-as Grace Hopper is 72x Neoverse V2. Comparing versus big GB100: 2560/96 CUDA/Tensor cores here vs big Blackwell's 18432/576 cores.

> Compared to NVIDIA Jetson AGX Orin, it provides up to 7.5x higher AI compute and 3.5x better energy efficiency.

I could really use a table of all the various options Nvidia has! Jetson AGX Orin (2023) seems to start at ~$1700 for a 32GB system, with 204GB/s bandwidth, 1792 Ampere, 56 Tensor, & 8 A78AE ARM Cores, 200 TOPS "AI Performance", 15-45W. Slightly bigger model of 2048/64/12 cores/275 TOPS, 15-60W available. https://en.wikipedia.org/wiki/Nvidia_Jetson#Performance

Now Jetson T5000 is 2070 TFLOPS (but FP4 - Sparse! Still ~double-ish). 2560 Core Blackwell, 96 Tensor cores, 14 Neoverse V3AE cores. 273GB/s 128GB. 4x25Gbe is a neat new addition. 40-130W. There's also a lower spec T4000.

Seems like a pretty in line leap at 2x the price!

Looks like a physically pretty big unit. Big enough to scratch my head in the intro video of robots opening up the package & wonder: where are they going to fit their new brain? But man, the breakdown diagram: it's- unsurprisingly- half heatsink.

It should be noted that Neoverse V3AE and Neoverse V3 are the automotive/server versions of the Cortex-X4 core, which is well known from many smartphones (and which is similar in performance to the Skymont E-cores of the Intel Lunar Lake, Arrow Lake S and Arrow Lake H CPUs).

While the Cortex-X925, the successor of Cortex-X4, has better absolute performance, it has much worse performance per die area. Therefore, for a CPU where the best multi-threaded performance is desired, Neoverse V3AE/Neoverse V3/Cortex-X4 remains the best CPU core designed by the Arm company.

This year's Arm core announcements have been delayed and it is not clear how the future Cortex-A930 and Cortex-X930 will compare with the currently existing Cortex-X4, Cortex-A725 and Cortex-X925.