If you were screwing around with Auto-GPT in 2023, you'll hit four years of "agentic" experience next year.

Of course, there's not much overlap between that and the way it works now. But then again, I have the same feeling about last year and this year... (e.g. Anthropic just deleted almost their entire system prompt because the models have common sense now.)

That being said, I think there's still value, even today, in playing around with the older models from time the time. (Or with very small recent models, which have similar limitations.)

Some of the habits that teaches you — i.e. careful context management and well crafted examples — do translate well to the modern environment, and give you performance gains and cost savings even with newer models. (In a word, whenever possible, show, don't tell.)

I also lament the loss of the base/text models, which were extraordinarily interesting and fun to play with. But that's a separate discussion :)