There was also the theory that is was because they scanned a bunch of actual real books and book paper has a slight yellow hue.

That seems unlikely, as we didn't see anything like that with Dall-E, unless the auto regressive nature of gpt-image somehow was more influenced by it.