Seeing what came later with gauge theories and more speculative stuff like loop quantum gravity, you can't blame Einstein for thinking that the theory of everything might take the form of a set of field equations for a connection. Math was just too hard, and the answer probably doesn't look like that after all.