It seems like server-side would suffer from issues due to buffering lookahead and autoplay. A client can request a video that is skipped within seconds, but if buffering causes it to request five minutes worth, the server only sees five minutes were requested, whereas the client can clearly tell how much of that was actually watched.