Remix.run Logo
▲ demibabs 29 minutes ago

> It seems that pre-training actually led to fairly human-aligned models

Did it? The famous Bing Sydney incidents (where it told a journalist to divorce his wife and be with it instead, among other things) were because the model was barely RL’d.