| ▲ | layer8 3 hours ago | |||||||
They did test for correct interpretation, so what point are you making? | ||||||||
| ▲ | nightski an hour ago | parent [-] | |||||||
From what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something. | ||||||||
| ||||||||