I have a keyboard and monitor somewhere in a closet. That's also what we do at work with our "real" servers.
I'd say it's needed about once a year at most though. Servers don't just fail to start, normally.