How can “should of” sound bad to you, when it sounds identical to (a not super carefully enunciated pronunciation of) “should have”, at least in every dialect I’m aware of

Except in rapid speech, and particularly at the end of sentences, I can definitely hear “should of” being used by some people in local Australian English.