It is if it’s GPU compute.

Distributed GPU compute has existed for quite some time,

https://developer.nvidia.com/gpudirect

And this is because I can't be bothered to dive into older papers, so recent NVIDIA stuff will do.