I found the Karpathy videos very approachable. While I did study CS, I never went deep into ML. My main knowledge about matrices is for graphic development, so vectors and matrices up to 4x4 in size only. But following the videos, starting to learn about backprob and building the tiny GPT was understandable to me.

Karpathy's lessons are great to really grog the background and underlying basics. They do not go into the many libraries available, the course you link might be more practically applicable.