Why don't JITs preserve previous work across runs of the same code?

If you encounter code with the same hash as last time, load up the previously generated binary and run that... or is that already happening?