Weird moment for this take. We're seeing some of the fastest and most impressive progress ever right now.

Frontier labs have categorically different & better set ups for evaluation, they're fine. It's work but it's not a crisis.

I've heard that every week of every month for the past three years. And yet, ask an LLM about a seahorse emoji and see what happens.