Seeing what came later with gauge theories and more speculative stuff like loop quantum gravity, you can't blame Einstein for thinking that the theory of everything might take the form of a set of field equations for a connection. Math was just too hard, and the answer probably doesn't look like that after all.

"downplays that Einstein was pivotal in emerging the field in the first place."

Indeed, its a pretty easy case to make the Einstein has more to do with QM as it currently exists than Bohr does. The major interesting work on QM after the 1960s or so is entirely dependent upon Einstein's work on QM and locality. The entire narrative in fact comes from Bohr's hissy fit after Einstein pointed out that QM is non-local and that seems very wrong.

Yes and being 'opposed' to QM contributed to expose the 'spooky action at distance' that QM implies, which is very important.. It's a pity that experimentators were able to demonstrate it only a long time after Einstein's death, what would have been his reaction??

Not a physicist either but my understanding is that is that if you believe that we can discover all the laws of physics that explain how the world operates then it needs to have a solution.

Like we have formulas describing how gravity works. We can test these formulas by observing the motion of the planets and galaxies. Is this theory true? There's lots of evidence for it so it feels like it's gotta be pretty close to "the truth"

We also have formulas describing how elementary particles behave. These formulas have been tested to a very high degree of precision so it seems they've got to be close to the truth as well. But if you use both our formulas for gravitation and formulas for elementary particles you can derive a contradiction. So these two theories cannot simultaneously be true. There's got to be something wrong with them.

I suppose there's the possibility that at a certain point nature simply doesn't follow any laws and you can't possibly make sense of it.

Well, the universe does something with extremely small but extremely heavy objects, unless you think that merely creating that situation will cause the universe to cease to exist.

So we do know that all the tiny interactions like charge of particles etc must work side by side with all the big interactions like gravity as otherwise how would anything as we know it work. However it could as easily be neither are the right way to interpret the world and there is something we are missing, or we are right and we can find a method to combine the theory of the big and the small interactions but we are missing a section. At the end of the day we can't interact in any meaningful way with more than half the matter in the universe (it's proven to exist due to a gravitational pull), so it's clear we can't experience a lot of the universe and we definitely can't explain a lot.

So yes there is a solution, but do we, as humans, have the ability to come up with it, who knows. I would say it's unlikely.