Not going probably never even crossed his mind. Social status in Roman society was very strongly influenced by military success. He was a previously successful general.

Historically (with all the accuracy you get when you summarize all of history) raising an army and not leading it was effectively telling everyone that you should be replaced by whoever did lead it.