Not a physicist either but my understanding is that is that if you believe that we can discover all the laws of physics that explain how the world operates then it needs to have a solution.

Like we have formulas describing how gravity works. We can test these formulas by observing the motion of the planets and galaxies. Is this theory true? There's lots of evidence for it so it feels like it's gotta be pretty close to "the truth"

We also have formulas describing how elementary particles behave. These formulas have been tested to a very high degree of precision so it seems they've got to be close to the truth as well. But if you use both our formulas for gravitation and formulas for elementary particles you can derive a contradiction. So these two theories cannot simultaneously be true. There's got to be something wrong with them.

I suppose there's the possibility that at a certain point nature simply doesn't follow any laws and you can't possibly make sense of it.