That’s what it means in the literal sense. As a more practical interpretation, p value is the ”probability that the observed result was due to random chance instead of the suggested hypothesis”