You will be surprised of The Unreasonable Effectiveness of opencv.calcOpticalFlowPyrLK
Which is a special case of mathematics.