With context windows starting to get much larger (see the recent 1M context size for Claude models), I think this will be a non-issue very soon.