Remix.run Logo
A Trick for Backpropagation of Linear Transformations(tripplyons.com)
74 points by tripplyons 5 days ago | 6 comments
hansvm 2 days ago | parent | next [-]

That's quite a neat trick. You do need to be careful if the same matrix appears more than once in your einsum call though.

brandonb 2 days ago | parent | prev | next [-]

Very nicely explained. Your article on rendering fractals was also well-done!

tripplyons 2 days ago | parent [-]

Thank you!

greatgib 3 days ago | parent | prev | next [-]

Nice and easy article for a normally complicated topic.

fzimmermann89 2 days ago | parent | prev [-]

..and for complex valued tensors, you need to conjugate.

tripplyons 2 days ago | parent [-]

I've only accounted for real numbers. I'm not sure how to cleanly account for conjugates when some of the einsums would need them and others wouldn't.

For example, a matrix product would need a complex conjugate, but a Hadamard product wouldn't.

If there is an elegant way to extend this to complex numbers, let me know!