I belive that is what NPUs are.

The issue is the very huge amount of DRAM and high bandwidth these model require.