> it's advancing fast

Actually, it (LLM models) has been advancing slower for a while. This is pretty much in the mainstream. And the current approach is facing all sorts of obstacles that are not exclusively technological. The compute needs are no longer sustainable. Financially, big labs are drowning in debt and backlash against data centres has grown so much that it has become an electoral topic in at least one major country.