> rarely we get things wrong (e.g. classical physics)

Curious, do you think quantum physics is the end of the line? I wouldn't claim to have a good understanding of anything beyond classical physics, but I've just assumed it's turtles all the way down and at some point we'll find serious issues with the quantum model

I think you’re right and quantum physics is false in some subtle way. We already found experiments that contradict existing theories in quantum physics, e.g. https://en.wikipedia.org/wiki/Cosmological_constant_problem

But it’s true enough to detect subtle gravitational waves, build clocks accurate to the nanosecond, and other amazing things.