I think the models deteriorate over time with more inputs. I think the noise increases like photocopies of photocopies

If you mean within an individual context window, yes, that's a known phenomenon.

If you mean over the lifetime of a model being deployed, no, that's not how these models are trained.