Remix.run Logo
▲ robrenaud 5 hours ago

Would PPO learn quickly from the hand engineered solution? Is PPO getting a terrible init?

It's interesting to see how tolerant of tedium the models are.

▲AshotSanamyan 17 minutes ago | parent [-]

Interesting question. My guess is it would learn faster at first, then drift away from the hand-built solution, unless you somehow hold it close for the first part of training. Would love to see someone try it.