Remix.run Logo
Jeff_Brown 2 hours ago

The burning question I can't get any information nn is whether, if they determined an earlier misaligned generation may have transmitted misalignment to the current models, they would roll back to a safe checkpoint to rebuild from there. I suspect they would not unless forced to.

piyh 35 minutes ago | parent | next [-]

Opus was trained based on it's internal CoT due to a bug for generations. Gemini's depression extended through models. OpenAI has killed people. We've already seen cross gen misalingment.

grim_io an hour ago | parent | prev | next [-]

They would maybe try to deactivate that bad "gene" and move on, exposing future models to "genetic disorders".

coherentpony an hour ago | parent | prev [-]

“All models are wrong. Some are useful.” - George Box