Remix.run Logo
▲ layer8 3 hours ago

They did test for correct interpretation, so what point are you making?

▲nightski an hour ago | parent [-]

From what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something.

▲lnenad 24 minutes ago | parent [-]

But increasing performance on a single task was the point of the change?