Remix.run Logo
▲ buffalobuffalo an hour ago

Thinking about it, it makes a lot of sense that LLMs could easily be trained to interpret weights. The attention mechanism of an LLM is very well suited to analyze a set of weights (in text form), since the attention to each weight in the text via key/query can sort of emulate the connection structure of the network that the weights represent.