Do you have a significant number of tabs opened? I've noticed a similar issue and my hunch is it was due to "tab rot".

I’ve found this to be the case, but I absolutely do not consider this acceptable. It’s just uncontrolled memory use. I also experience this on Safari though, so I suspect it’s a WebKit issue.