I’ve observed this consistently.
It’s scary how easy it is to fool these models, and how often they just confuse themselves and confidently march forward with complete bullshit.