A colleague of mine was in a similar situation except he had an eSIM. It didn’t help because AT&T would not provision him a new eSIM internationally.

As another anecdotal data point, I was able to switch phones internationally using a physical SIM by just putting it in the new phone.