CUDA was well-used in HPC and other compute-intensive spaces long before neural nets were in style.

If you look at the evolution of GPGPU computing, at least from an HPC perspective, CUDA is almost an obvious step. What’s perplexing is that AMD and Intel let it get so far ahead in the late 2000s and early 2010s.