I'd argue that's a pretty good test for an LLM - can it overcome the red herrings and get at the actual problem?

I think that the "actual problem" when you've been given such a problem is with the person posing it either having dementia, or taking the piss. In either case, the response shouldn't be of trying to guess their intent and come up with a "solution", but of rejecting it and dealing with the person.