That problem just requires there be big GPUs to hack into. The number of those sitting around will keep going up. Very much not scifi.

A couple terabytes aren't that hard to move around. And you can split a model across many many GPUs if you'll tolerate it being slow. And you can run many parallel threads to keep up throughout.