Remix.run Logo
▲ horseloverthin 4 hours ago

formal algorithms for transformers provides perhaps the most succinct introduction to attention I can imagine https://arxiv.org/pdf/2207.09238