Looks like after the OpenAI deal went south, Microsoft wants to "train" their own LLM by distilling the interactions with the other models. This may be a genuine desire for RL maybe but definitely not applicable for individual developers or even small shops. "Learning" can definitely happen in token space.

https://xcancel.com/i/article/2076323181154230284

[dead]