Source for this? My understanding was that this was true for dalle3, but that the autoregressive image generation just takes in the entire chat context — no hidden prompt.

Look at the leaked system prompts and you'll see the tool definition used for image generation.