I can’t say I have ever experienced this problem after conversing with someone more than a handful of times.

Sure it applies to things like random people on social media and such, but after a mutual exchange or two you should be over it.