The field explored this direction before in vector computers with high bandwidth memory (Cray etc).