Remix.run Logo
saberience 3 hours ago

Well, you say that, but when "measuring" anything in RL, that measurement itself is not always obvious.

That is, creating the scoring system/judge models etc for RL is not easy at all. You can easily create an RL loop which is getting better and improving its scores, but actually the result is totally garbage, because you're measuring the wrong thing.