> show me a 4th grade math problem they can't handle

Sure.

"8 7 6 5 4 3 2 1 - add minus signs and parenthesis to get 31."

P.S. There is an answer online and some LLMs will just copy it verbatim. This doesn't count.

simonw an hour ago | parent | next [-]

Whoa, 4th grade math problems got hard! I'm not sure how I'd tackle that one myself.

	▲	simonw 15 minutes ago \| parent [-]
		GPT-5.5 found a solution only after assuming that you're allowed to concatenate numbers together e.g. 8 7 becomes 87 (it complained at first that it was "under-specified") - using Python it brute-forced a solution (actually finding 13): https://chatgpt.com/share/6a1db54f-7ab8-8333-9218-86a469c284... Are you sure this is 4th grade level?

[dead]