That's part of the Great Filter answer to the Fermi paradox. Though, I agree, it's not really a paradox. If the great filter is true, the first filter is life forming at all. We hope that the filter is behind us and that's why intelligent life in the universe seems rare, rather than ahead of us. If life is common, but intelligent life is uncommon, that's concerning because it makes it more likely that the filter is ahead of us. Meaning, something like, once an organism has control over the whole planet there's something that prevents them from going to multiple planets.