If you need to track covariance you might want to play with gvar https://gvar.readthedocs.io/en/latest/ in python.