| ▲ | technotony 3 hours ago | |
I'm not sure. That paper from anthropic talked about monitoring j space, presumably those same techniques would work here? | ||
| ▲ | SubiculumCode 3 hours ago | parent [-] | |
I am no expert, but I think it is this: 1) We have few effective tools at monitoring alignment right now, and chain of thought is one of the more effective. 2) Monitoring latent space may be possible, but I do not think it is even close to being a solved problem, nor whether it is possible at scale and outside of controlled problem areas. 3) Finally, more recursion within latent space may complexify the latent representations, not simplify them. | ||