▲ | lblume 6 days ago | |
How is this relevant? Modern LLMs don't rearrange words at all in a meaningful sense of the word, and are certainly better than just using random chance to sample tokens. | ||
▲ | cantor_S_drug 6 days ago | parent [-] | |
Indeed it is exactly that process. They cutup words. Then categorize them based on some metric of nearness (not random). Then link them up. Obviously this process is much more sophisticated than what I have described here. |