We are still in the middle of the AI race. Commodity hardware is easy to use, can do everything and is fast enough.

Your optimized hardware chip might be obsolete before its back from the fab.

SOTA Frontiermodelhardwarechip is a benchmark point of a potential model slow down.

Google is doing it right now under project Frozen v2 which should be ready by 2028? which is either just a small experiment or flexible enough and thats why it takes so long for it to happen.