| ▲ | sanxiyn 7 hours ago | |||||||
There is. Official leaderboard is without harness, and community leaderboard is with harness. Read ARC-AGI-3 Technical Paper for details. | ||||||||
| ▲ | falcor84 7 hours ago | parent [-] | |||||||
I went through the technical paper again, and while they explain why they decided against the harness, I disagree with them - my take is that if harnesses are overfitting, then they should be penalized on the hidden test set. Anyway, searching both in ARC-AGI's paper and website and directly on kaggle, I failed to find a with-harness leaderboard; can you please give the link? | ||||||||
| ||||||||