Remix.run Logo
▲ minimaxir 6 hours ago

ChatGPT Images (and some others like Nano Banana) are autoregressive models, and the text model generates the tokens in the same way which are then passed in the correct form for an image model to decode. That is how it can reason the prime numbers + Pokemon + art style conditional.

It is different from earlier image models which just use a simple text encoder and struggle with conditional logic if not explicitly trained for it.