Ideally, one should explore all possibilities. It is remarkable how far "merely" predicting the next word has taken us.

That was constant progress with measurable goals, not "big things are coming decade from now" every decade.