Self improvement during training, and AI self training are already happening. Easily/quickly are seemingly a factor of how much power/hardware you want to use at once.

With the level of compute they have they aren't stuck with frozen models like you are.