Remix.run Logo
dlcarrier 4 days ago

Low-power processors rarely have the AI accelerated instructions in the GPU, instead opting either for dedicated matrix/tensor cores, or as is used in the case, adding the acceleration instructions directly to the CPU core.

This results in a higher performance per Watt, but doesn't scale well to higher-power applications.