Indeed.
It's disconcerting at times, the scope of finite and infinite dimensional linear algebra, especially when done on a convenient basis.