Remix.run Logo
thaumasiotes 14 hours ago

But what is the value of reproducing your results that way? Those results only mean anything if they're similar to what happens with other seeds.

dzaima 11 hours ago | parent | next [-]

If everything goes roughly the same with all seeds, then everything's indeed just fine. If not, I have a paper trail that I did in fact actually encounter the unexpected thing instead of just making up results. (indeed a seed could be cherry-picked, but the more is computed from the seed, the more infeasible that gets)

And that hints at the possibility of using seeds specifically for noting rare occurrences - communicating weird/unexpected(/buggy?) examples to collaborators, running for X hours to gather statistics without having to store all intermediate states of every single attempt if you later want to do extra analysis for cases insufficiently analyzed by the existing code, etc.

saagarjha 14 hours ago | parent | prev [-]

If something fails, I can reproduce the failure with your seed.