The poor have a right to vote, while they don't have a right to operate a motor vehicle. We can debate over how disenfranchising it is to be unable to drive in the US (very), but the law makes a pretty clear distinction between these two activities.