No, you've got it right. A lot of people trying to be cute and make southern language seem more alien than it is are over-"correcting."

When southern people say y'all to one person, they're really addressing you and your family (even though you might be the only one there.) If I ask "how y'all doing?" I want to know how you and yours are doing.