That's not more of a problem than synchronizing the player names at game start. It's table stakes for an online game.

If you synchronize the seed at game start for speedruns, the seed is the same for everyone, and players can again manipulate their luck, so nothing was gained.