It’s still rendering frames constantly, no? So it just figures the next X frames are all doing nothing?

Normal only keypresses invoke the next ”frame”. There is a sleep token that the runner could use to indicate that time is moving.