Currently the quality seems to degrade long before the context limit is reached, as the context becomes “polluted”.
Should we expect the higher limit to also increase the practical context size proportionally?