Almost everything in ML is like that. It seems so obvious in hindsight. It's maybe what I love most.
Residual connections are so simple, so obvious and so vital. Yet nobody came up with them until 2015?