Well, in short - basic linear algebra, basic probability, analysis (functions like exp), gradient.

At some point I tried to create an introduction step-by-step, where people can interact with these concepts and see how to express it in PyTorch:

https://github.com/stared/thinking-in-tensors-writing-in-pyt...

▲

MichaelRazum 5 days ago | parent [-]

Although is it really "understanding" or just able to write down the formulas...?

▲

stared 5 days ago | parent | next [-]

Being able to use a formula is the first, and necessary, step for understanding.

Then it is able to work at different levels of abstraction and being able to find analogies. But at this point, in my understanding, "understanding" is a never-ending well.

	▲	MichaelRazum 5 days ago \| parent [-]
		How about elliptic curve cryptography then? I just think coming with a formula is not really understanding. Actually most often the “real” formula is the end step of understanding through derivation. ML does it up side down in this regard

▲

misternintendo 5 days ago | parent | prev [-]

In some way it is true. Like understanding how a car works purely on physics laws.

	▲	5 days ago \| parent [-]
		[deleted]