| ▲ | amplifydev 4 hours ago | |
Interesting! Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it. | ||
| ▲ | achandra03 4 hours ago | parent | next [-] | |
Not a book, but 3blue1brown's video on attention is pretty great: https://www.youtube.com/watch?v=eMlx5fFNoYc | ||
| ▲ | horseloverthin 4 hours ago | parent | prev [-] | |
formal algorithms for transformers provides perhaps the most succinct introduction to attention I can imagine https://arxiv.org/pdf/2207.09238 | ||