The average person didn't vote.

If you're referring to voters staying home, staying home is a vote for their state's majority. There's no sense in which the average citizen in a democracy is not responsible for the outcome of a democratic vote.