> Does this have some significance for back propagation or something

You're right!

What could darn possibly matter these days, in the whole entirety of the realm Mathematics, if it does now somehow have a measurable impact on backprop ?