Remix.run Logo
stared 5 days ago

The original title is "Yes you should understand backprop" - which is good and descriptive.

dpflan 4 days ago | parent [-]

Agree, better title for this post; the fact that back prop is a leaky abstraction is a reason one should understand it and know how to do the mechanics by hand to truly experience it and develop understanding and intuition. Software / code abstracting away even more of the process leaves it open to magical thinking. I had to do hand calculations and convolutions in my Deep Learning graduate school course.

xpe 4 days ago | parent [-]

Yep. Also, I don’t find the metaphorical connection to leaky abstractions useful at all. It feels strained.