Probably one of the first articles on this topic which I have read to the finish line and understood everything fully. Thanks.

Same here, I've never done any study of these things other than learning a bit about gradient descent out of interest. But the idea that these networks work as classifiers by figuring out boundary regions was more interesting than I previously believed.