I think they're quite explicitly saying they already can determine your demographics from your chats. Which is almost certainly true for most users.

I don't chat - I prompt. And usually zero-shot in an incognito window. I doubt it'll determine much of anything about my demographics.

they definitely can do that already, and chatGPT will happily tell you all the demographics it thinks it knows about you if you ask it.