Indeed. This is the "bitter lesson".

https://en.wikipedia.org/wiki/Bitter_lesson