It’s a good idea. The results probably depend a lot on how close your task is to the benchmarks though.

I think OpenAI already has (had?) a feature like this called “auto” mode for thinking.