Likely the cheapest solution they could get at this scale, so yes, RAG
RAG with clever attention mechanisms?