GPT wouldn't have even been possible, let alone take off, without self supervised learning.