| ▲ | data-ottawa 2 hours ago | |
Perhaps I’m missing this, but can Qwen 3.8 alter Qwen 3.8 weights? There are a lot of known neurons in the older Qwen models that are long known to induce behaviour changes (see evil Qwen by changing one weight). My question boils down to how much is trained vs being able to actually understand the weights. Presumably a same gen model isn’t trained on any sources dissecting that generation. And how much do longer known conceits like steering vectors, J spaces, LoRAs play into this? This doesn’t explain the game training cases, which are very impressive to me. | ||
| ▲ | Flere-Imsaho an hour ago | parent | next [-] | |
Ok now the idea that models can alter weights is out there, does that mean there will be models in the future that are heavily trained to modify model weights? The future is going to be wild. | ||
| ▲ | seanmcdirmid 2 hours ago | parent | prev [-] | |
A Qwen3.8-27B model can probably do something with a Qwen3.5-0.8B model. I don't think this is so much the version (Qwen 3.8 vs Qwen 3.5) but the model size (27B vs 0.8B). But ya, having research on Qwen 3.5 definitely helps. | ||