Remix.run Logo
▲ mariopt 2 hours ago

I think it's pretty evident that Artificial Analysis loves to change the benchmark to place US models on the top, it's no the first time either.

The current placement of many models simply doesn't makes sense, GLM 5.3 is so much better than Astra at backend tasks, Astra does the most weird nonsensical bugs.

This is what happens when the benchmark team is funded by VC capital.

▲dannyw 42 minutes ago | parent [-]

Even and especially for frontend UI, GLM 5.3 is a whole world better than Astra.

I can see (and believe) Astra beating GLM 5.3 on verifiable hard domains like maths, etc; but we’re at this stage where intelligence scores and even ‘frontier real world unsaturated benchmarks’ really doesn’t reflect real world use anymore.