>If there's a real chance (say 10% or greater) that one of the AI labs is going to end the world, then yeah it should be a crime to continue advancing the technology.

>but since they seem to believe it and they're the ones working on it, the technology should be halted.

Again, you're missing the dynamic that stopping AI development yourself doesn't mean that others' AI development will also halt, and other labs has higher P(doom) than your lab (of course!).

Stopping yourself from committing a crime generally doesn't stop others from doing so. That's not your responsibility though.