So I think what’s a little unfair there is that “you could have invented container runtimes”[1] is an article which really tries to answer ‘how does someone who works in traditional software development with an understanding of operating systems and deployment that is a few years out of date get brought up to date on what they need to know so that to them, something like container runtimes become a logical and obvious thing that solves a problem they now understand?’

What this particular mathematical writeup seems to address is ‘how does someone who is already up to speed on the mathematical underpinnings of attention kernel neural networks get brought up to date on what they need to understand in order to see this new algorithm as obvious’

Which is a smaller audience to be sure, and - given how fast this field has grown - somewhat disingenuous in its implications.

This kind of title is appropriate for a piece aimed at helping someone who is a little behind the curve catch up. In the field of deep learning it should be obvious even to the people inside it riding that curve that it is moving really fast and that this kind of content only works for people who are running to keep up.

[1] https://medium.com/@gtrevorjay/you-could-have-invented-conta...