The rise in prevalence is recent, but older than transformer models by a comfortable margin.

https://books.google.com/ngrams/graph?content=delve&year_sta...