I have the same feeling and I use evil-mode in Emacs because of that. It's basically Vim inside of Emacs.

I tried evil-mode for awhile, but it had too many edge cases that behave differently so I went back /shrug