No, that is a red herring, as he explains. It's not about the labels at all, there's no reason to assume the writer of the labels even knew anything about the actual location of the treasure. They're not part of the puzzle rules.

That won't stop them from being inconsistent.