I think you're conflating abstraction like E=mc^2 and concrete ground truth of every moment ever everywhere in the observable/non-observable (observable has to come from somewhere) universe.

Yeah we can and have formed general conclusions from what has been observed.

But Gödel was talking to the limits of usefulness of abstraction like E=mc^2 when it comes to determining past and future physical truth to a high precision.

E=mc^2 is, to conjure an absurd simile to invoke a reaction of how insane the effort would feel, like saying there's a rock on a hill.

Gives us nothing about the shape, color, mass... any sentences describing the concrete properties cannot be proven without observation.

Technically we cannot empirically know if E=mc^2 was true 700 billion years ago. Our trusted abstraction are only relatively true.