| ▲ | buffalobuffalo an hour ago | |
Thinking about it, it makes a lot of sense that LLMs could easily be trained to interpret weights. The attention mechanism of an LLM is very well suited to analyze a set of weights (in text form), since the attention to each weight in the text via key/query can sort of emulate the connection structure of the network that the weights represent. | ||