I imagine this is basically not at all due to actual model changes.

If you use Codex, Claude Code, etc, those are being constantly updated. That sort of behavior would be highly harness dependent.