| ▲ | rotis an hour ago | |||||||
thinking_effort: max Reasoning trace: This is the classic pelican-on-bicycle SVG test. Opus 5.5 had similar response on max: This is a classic test request https://tools.simonwillison.net/markdown-svg-renderer?url=ht... I think your test is already embedded into the models. You should search for new frontier tests to subject the models to. Maybe they should now try to unify the standard model and general relativity in physics. I'm pretty sure this is nowhere to be found in any training data nor shared in any chat between a scientist and a LLM ;) | ||||||||
| ▲ | simonw 39 minutes ago | parent | next [-] | |||||||
The fact that they've heard of the test doesn't seem to help them draw a good picture of a pelican riding a bicycle. | ||||||||
| ||||||||
| ▲ | breezybottom 11 minutes ago | parent | prev [-] | |||||||
LLMs hallucinate and pander. Calling something "classic" is a common LLMism | ||||||||