I've seen this too. I had a couple of instances inside a tmux session, and after some time, everything in there slowed down to a crawl. What I found interesting is that terminals outside tmux were fine.