I feel like a more interesting question is what proportion of users can connect to an IPv6-only server?

Almost 50% according to google: https://www.google.com/intl/en/ipv6/ (But other measurement statistics project a lower value.)