"Going forward we will capitulate and still try to keep the integrity of our benchmark in tact, but from now on every benchmark will be compromised with providers being able tweak things sufficiently to game at least a 30% bump in results."

▲

simianwords 6 hours ago | parent [-]

"I'll twist the words of the author of the benchmark itself to make a point"

▲

ActionHank 6 hours ago | parent [-]

"I refuse to see the wall that I am running directly into, because if I see it I will hit it"

	▲	simianwords 6 hours ago \| parent [-]
		If you mean a capability wall, the author of the benchmark says this >We see Astra as a major breakthrough in model intelligence. You think the author of the benchmark is also in the conspiracy