That's how I've always understood the rule as a native speaker, even though I don't think it was ever taught (to me) in school growing up. It all depends on how the next word sounds.