Your last sentence is the important one, yeah? On a spectrum of intelligence or expertise, the higher end would be defined (ish) by knowing the right color or having better guesses anyway.

Like someone restoring the Sistine Chapel would ideally have some of: knows what it looked like before because they've been working on it for thirty years, because they've been researching and/or have access to photos or some other historical documents of it's priors, because they're educated on the types of materials and pigments from the time, maybe they know something about the daily use/tourism of the place and how/whether it should change some parts of the restoration. In the absence of those things, then infer that something should be purple-ish because it's blue to the left and red to the right. This is good, but perhaps below great. Maybe the gap should have a hard line between the two colors or maybe there was an object in there.

And of course plenty of people maybe just don't care, aren't getting paid enough, don't have enough discipline to get the right purple, or are playing to their supervisor's eye rather than their trained intuition. The last one having a lot to do with the notion of "plausible". This effort aspect is I guess different, but still related/adjacent to what comes out of or how that "intelligence" is deployed.