A few random thoughts:

There are many new data-centers they are being filled with servers. Most servers have at least 2 HDD (mirror) for the OS. I would not be surprised if on a huge scale even 2 HDD per server could cause HDD shortage.

There are likely models which are trained on 4k video and it should be stored somewhere too.

Even things like logs and metrics can consume petabytes for a large (and complex) cluster. And the less mature the software the more logs you need to debug it in production.

In the AI race investments if not unlimited at least abundant. In such conditions optimization of hardware usage is the waste of time and velocity is the only things which matters.

So at least for HDDs it is unlikely they will have super custom "AI HDDs" like thay have with custom High Bandwidth Memory displacing regular RAM in fab output & being harder to reuse later.

So hopefully once they all go bust, there should be a lot of cheap enterprise HDDs on the marked as creditors pick through the wreckage. :)