https://tinygrad.org/ is the only viable alternative to CUDA that I have seen popup in the past few years.

djsjajah an hour ago | parent | next [-]

I can't tell if you are making a joke or not.

They are not even remotely equivalent. tinygrad is a toy.

If you are serious, I would be interested to hear how you see tinygrad replacing CUDA. I could see a tiny grad zealot arguing that it is gong to replace torch, but CUDA??

Have you looked into AMD support in torch? I would wager that like for like, a torch/amd implementation of a models is going to run rings around a tinygrad/amd implementation.

▲

erichocean 4 hours ago | parent | prev | next [-]

Both Mojo and ThunderKittens/HipKittens are viable on AMD.

	▲	balaclava9 3 hours ago \| parent [-]
		Mojo runs faster on nvidia hardware than CUDA in some cases. https://x.com/clattner_llvm/status/1982196673771139466?s=61

▲

bigyabai 5 hours ago | parent | prev [-]

Viable how? "Feasible" might be a better word here, I haven't heard many (any?) war-stories about a TinyBox in production but maybe I'm OOTL.