I disagree that things have improved with any particular rapidity. The LLMs of today are not really much more capable than GPT-3.5 was.

Excellent point, I should have expanded to the previous; 5 years or even better post and pre covid.