Remix.run Logo
▲ spuz 2 hours ago

My point was that it is a core but not necessarily correlated metric and it sounds like you agree with that.

▲hypfer 2 hours ago | parent [-]

Okay so, the graph is "informative" because it plots the perplexity value of the various OpenAI models over time?

That's it? That's all this submission has going for it?

Okay.

▲AlexCoventry an hour ago | parent [-]

That was all I'd apprehended of the post when I replied earlier.

The post argues that NTP perplexity is a good first approximation to model capability, and could therefore form the basis for an industry-wide commitment to pause model development at a given perplexity level until there's a consensus that AI alignment and safety has caught up enough that it's safe to continue developing even more capable models.

It's definitely not simply an ad.