Remix.run Logo
▲ tecleandor an hour ago

GPT-2 124M is terrible...

  > what is 2+2?
Answer:

  > 3+3? 4+4? 5+6? 7+8?
  > Reply ~18000 0 ~10 min 2 By : 1-1: I'm a beginner. 3x2 is my best option, but if you're not sure about the other options then just go for it and try again
▲krackers an hour ago | parent | next [-]

It's not instruct tuned looks like? It's closer to a base model rather than a chatbot.

▲logicallee 19 minutes ago | parent [-]

That one is a 2019 model :) Years before the ChatGPT public preview.

▲logicallee 19 minutes ago | parent | prev [-]

GPT-2 is an interesting one because it is a February 2019 model. (You can see some information about it below the card if you click on the card.)

That was 2-3 years before the big "ChatGPT moment" (the highly coherent ChatGPT research preview was released in November 2022, I think it was ChatGPT 3.5). Back in 2019 the models really were not producing very coherent output. Now you can see it for yourself right in your browser :) Everything has come a really long way since then!