Will this run on cards that don’t have ROCM/latest ROCM support? Because if not, its only gonna be a tiny subset of a tiny subset of cards that this will allow cuda to run on.

Yes. It outputs a hsaco binary that just runs on the GPU (as long as you have the driver). No ROCm needed.