You already can with AMD/Intel gpus. Kraid is a compiler for Arm Mali which is mostly used on mobile stuff, nothing AI related.