> would you have to give access to modern hardware in the experiment for it to use?

At a minimum, yes. IIRC, the sum total of all compute manufactured over history only reached the minimum needed to train an OK LMM in the mid 00s.

> How much could it infer from it?

Only way to find out is to try.