Although I see huge utility in AI, I think he is right in terms of overspending and overenthusiastic build out. Because of for example what Apple is doing by putting an extremely efficient model with task adapters right onto phones.

Also because we now have a massive demonstration that vastly more efficient hardware is desperately needed.

Similarly other effective efforts towards on-device AI like Nvidia RTX Spark PCs and 2bit quants of strong models like DS4.

So inevitably, significant investment will be going into vastly more efficient CIM efforts like Mythic AI and new FeFET devices etc. in order to make human-level and beyond AI at scale feasible. There is so much demand for this and the power requirements of current hardware are so excessive, it seems unlikely that the data center build-outs will be able to recoup their costs before the more efficient paradigms make it out of the lab and start scaling.