Not exactly - there are very clear areas where everyone agrees the dividing line exists when you look a full spectrum map. Even most colorblind will agree with the areas in general (there are lots of specific color blind types but most will agree what area of the map is which colors even if you don't put any scale indications on the map)

Within a particular culture that may be true, but for example the Japanese concept of blue/green is decidedly different from most Western concepts which consider blue and green separate colors.