| ▲ | The-Ergster 5 hours ago | |
I think this is much more significant that that. The article suggests more advanced weight adjustment | ||
| ▲ | BoorishBears 5 hours ago | parent [-] | |
No, this is a microstep above having a model generate synthetic SFT and many steps below advanced weight adjustment. The original paper that started this hyper was highly misleading because it started with toy networks where the models could directly modify weights, then drew a thread to fixing a reasoning model... but the two approaches were completely unrelated. The approach here was essentially abliteration, which any model able to write a few hundred lines of Python and generate synthetic examples can so. | ||