This isn't goalpost moving, it's pushing back against a misinterpretation of the paper's results (one that seems to have been encouraged by the authors).

Can we get a single human on this planet to go against Astra-6 on experiment 4 & 5? And for experiment 4 the human also has to do it "In a single try with no tools".

I don't think this is something I've seen a human do or even seen hinted that a human can do. So I'd love to see a human do it. My guess is virtually no standard ML engineer could do this. Maybe some savant could, but I suspect that is what it would take.

How is it pushing back, if anything it's mostly clarifying and the conclusion aligns with the original article:

> It’s cool that Astra was able to make direct weight updates. But we shouldn’t think of this like a radically new capability that will change how AI research is done. We should think of this as analogous to the ability of LLMs to emit machine code and tweak compiled binaries: it’s an impressive trick, but the best way to work with binaries is still to write source code and compile it.

It's like people are immediately forbidden to be impressed that AI was able to do this. The original article itself mentions the mechanisms by which Astra achieved this. They just of course wanted to gain more attention so they used a sensational title, like 90% of scientists that want their stuff read.

How is it not moving goalposts, it knew how to detect which weights to update and a way to do it? Even this article says so in the part that I quoted. The original piece never stated humans are unable to do this, I don't even think it implied it. So being impressed with this accomplishment is actually *ok*.