| ▲ | energy123 5 days ago | |
Given they asked in on LMArena, yes. | ||
| ▲ | lambda 5 days ago | parent [-] | |
Yeah, probably asking on LMArena makes this an invalid benchmark going forward, especially since I think Google is particular active in testing models on LMArena (as evidenced by the fact that I got their preview for this question). I'll need to find a new one, or actually put together a set of questions to use instead of just a single benchmark. | ||