Remix.run Logo
▲ nightski 2 hours ago

From what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something.

▲lnenad an hour ago | parent [-]

But increasing performance on a single task was the point of the change?

▲ 30 minutes ago | parent [-]
[deleted]