Live performance (like conversation or playing music) often relies on memory to do it well.

That might be a good criteria for how much to memorize: do you want to be able to do it live?