I don't know much about credit card validation, but I have the impression that the zipcode is just one more correlation that tells them you're more likely to be the real owner of the card.

If the 3 numbers I type match the 3 digits of the owner's postal code, it's probably a reasonable signal that I'm the owner (even without the letters).