They aren't trying to 'solve' chess, go, or mathematical proofs as an end in themselves, but mainly in order to learn more about how to build better systems overall. The goal of AlphaZero was ultimately as a stepping stone towards AGI, and it's the same with LLMs.

The assumption being that 1. these things are all stepping stones, not diversions 2. that ai labs have a singular goal of producing agi