| ▲ | croemer 2 hours ago | |
LLM written for sure: > The identity [...] is the whole trick. The outer product is a matrix; the inner product is a number. We no longer store every past key and value. We store their summed outer products in the fixed-size state S_t. | ||
| ▲ | robertclaus an hour ago | parent | next [-] | |
Ya, probably started with asking for a buzzy title. | ||
| ▲ | geraneum an hour ago | parent | prev [-] | |
This is what you get when you prompt claude to avoid – | ||