GPT-2 was the first wake-up call - one that a lot of people slept through.

Even within ML circles, there was a lot of skepticism or dismissive attitudes about GPT-2 - despite it being quite good at NLP/NLU.

I applaud those who had the foresight to call it out as a breakthrough back in 2019.

i think it was already pretty clear among practitioners by 2018 at the latest

	▲	ACCount37 3 days ago \| parent [-]
		It was obvious that "those AI architectures kick ass at NLP". It wasn't at all obvious that they might go all the way to something like GPT-4. I totally underestimated this back then myself.