Remix.run Logo
highfrequency 5 hours ago

Can you be more specific about which math results you are talking about? Looks like significant improvement on FrontierMath esp for the Pro model (most inference time compute).

ZeroCool2u 5 hours ago | parent [-]

Frontier Math, GPQA Diamond, and Browsecomp are the benchmarks I noticed this on.

csnweb 5 hours ago | parent [-]

Are you may be comparing the pro model to the non pro model with thinking? Granted it’s a bit confusing but the pro model is 10 times more expensive and probably much larger as well.

ZeroCool2u 5 hours ago | parent [-]

Ah yes, okay that makes more sense!