I’ve only seen that issue in extremely cheap, China-made, clothing.
It helps to buy high quality, and expensive, clothing. Sizing is consistent, and shape stays after multiple washes.
Googling BIFL in Reddit helps a lot.