> They are like almost like malicious compliance geniuses lol.

They're like a monkey's paw or evil genie I think.

You'll get exactly what you ask for, but lots of weirdness you didn't expect.

To be fair to the model makers, deciding what to do with an under-specified prompt is hard, particularly in an RL environment where you can't just ask the user.

For stuff I want to run for a while, I'm defaulting to telling it to ask me the questions upfront to reduce the incidence of these kinds of problems.