I wonder how this works? Are they just RAG-ing the chat history or something more clever?

Likely the cheapest solution they could get at this scale, so yes, RAG