I would assume it's pull-based so the agent takes a screenshot whenever it finishes a turn.

Essentially yes. For games with some real-time component (FFVII), the game pauses after actions are executed to take a screenshot and let the agent think.