This should help with better utilizing a heterogenous collection of inference hardware.