Remix.run Logo
dmitrygr 6 hours ago

> Purpose-Built for Agentic AI

From the "fridge purpose-built for storing only yellow tomatoes" and "car only built for people whose last name contains the letter W" series.

When can this insanity end? It is a completely normal garden-variety ARM SoC, it'll run Linux, same as every other ARM SoC does. It is as related to "Agentic $whatever" as your toaster is related to it

pdpi 5 hours ago | parent | next [-]

> It is as related to "Agentic $whatever" as your toaster is related to it

These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.

pezezin 3 hours ago | parent | next [-]

The huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.

kibibu 5 hours ago | parent | prev | next [-]

Would cloud gaming platforms benefit from the interconnect?

pdpi 5 hours ago | parent [-]

Don't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.

dmitrygr 5 hours ago | parent | prev [-]

mem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators

dpe82 5 hours ago | parent | prev | next [-]

The power and importance of marketing is deeply underappreciated by us technical types.

LogicFailsMe 5 hours ago | parent | next [-]

And yet more than a little Gavin Belson "Box III" vibes here. Fortunately, no signature edition.

dwb 5 hours ago | parent | prev [-]

I don’t underappreciate it, but I do despise it.

pwg 4 hours ago | parent | prev [-]

> It is a completely normal garden-variety ARM SoC

To mis-quote the politician quip:

How can you tell a marketer is lying?

Answer: His/her mouth is moving.