Your issue with physics but not with math reminds me a little of Hume's law. The difference that has always made that difference "make sense" to me is that math rules, even the axiom we use, are entirely chosen by the people using them, but the rules of physics are only useful if they match/predict what happens in the real world. For math we get to pick the ones that happen to be useful at a given time for a given problem (my go-to example of "it's all made up and the points don't matter" is why 1 isn't considered prime). For physics we're constrained to pick what best describes the real world. It probably helped that nearly all the physics course I had in high school/university had lab components focused on experimentally validating those rules/using those rules to predict results.

I think what it boils down to is that in my experience physics education lacks a clear historical component about how the current state of the art is a gradual process of proposing new models and rejecting old ones and figuring out the gaps between reality and the model. Instead, it feels like a God-given set of equations (that lots of people consider "the truth" for some reason), that you apply to cookie-cutter problems you must learn by rote. Though I understand the practical concerns (but then let's call it "physics for engineering"), as far as I'm concerned, you couldn't treat physics in a worse way.