I've never had this issue. Use the built-in datastructures that provide that functionality and you're good

Just because you haven't had it doesn't mean it doesn't exist. The built-ins just use unsafe extensively for these kind of algorithms - though that is of course completely fine here and there, since you will only use the safe APIs.