Given how fast models are improving, burning the weights into actual ROM is prohibitively expensive if you need (or want) to replace the chip every couple of months.

The alternative is on-TPU flash for storing the weights.