> Anthropic previously stated Claude had memorized solutions for the non Pro version of the benchmark

yeah that was the point of introducing the Pro version