| ▲ | kadoban 7 hours ago | |
I wonder what AA's funding and affiliations are. I get the sense that they have their hand on the scale at least a bit. | ||
| ▲ | lifeisloving 6 hours ago | parent [-] | |
Well yes, thats the entire business model of benchmarking companies. If you pay attention to AA, some models are on the leaderboard second they're released while others come days later, which to me implies that theres some level of coordination happening with them and a few labs. | ||