Highly economy specific. Ease varies by nation state. Social engineering attacks in Australia are far LESS common than they used to be and I believe other economies in Asia and Europe all have less than the USA.

If you aren't talking from a US perspective, where are you that SIM swap is a low bar?