But isn’t the Mac Mini the weak link in that scenario?
It has way more unified memory than your typical dGPU.
Yes obviously. That VRAM is also slower and has weak compute attached. Loading to the external GPU will slow things down too much.