the reason he (probably) wants that feature so badly is cos it crashes his amdgpu driver when he tries inferencing lol

although, as an amd user, he should know that both vulkan and rocm backends have equal propensity to crap the bed...