Learning the basics of how LLMs work is legitimately doable in a weekend if you have ever passed a linear algebra course.

If you are actually good at linear algebra, it's doable in an afternoon.

They are fantastically simple in structure, all the intelligence is in the massive piles of data in them, not their structure. Then there is of course a lot of room in optimization once the basics are done.

If interested, maybe start here: https://www.deeplearning.ai/courses/how-transformer-llms-wor...

In a afternoon, I can parse the equations. But intuitively understanding why it works? I am unable to understand, after years of trying.

A bit more than that. You need to understand Hessians to compute the loss function efficiently

[flagged]