Yeah, until OpenAI says "we pasted the questions from ICPC into chatgpt.com and it scored 12/12" the average user isn't really going to be able to reproduce their results.

▲

SamPatt 4 days ago | parent | next [-]

The average user will never need to answer ICPC questions though.

	▲	Jensson 4 days ago \| parent [-]
		No, but the average users have things they want to do that require ICPC level problem solutions. Like making optimized games etc, average users wants that for sure.

▲

anthonypasq 5 days ago | parent | prev [-]

the average person doesnt need to do that. The benchmark for "is this response accurate and personable enough" on any basic chat app has been saturated for at least a year at this point.