Seems likeliest that it didn’t even “memorize” anything, in the anthropomorphic sense. The Rubik’s cube algorithm is trivially representable in code, as long as the interface for interacting with a cube is well-designed / well-defined.

I’m no more surprised that an LLM can solve a Rubik’s cube than it can send an HTTP request.