I have hunch PGO does detect when bound check can be eliminated.

How so? PGO might indicate that most of the time arguments are in bounds, but that's not enough. It has to be a proof with 100% certainty before bound checks can be removed

bound check elimination exists separately, PGO can help unveil more opportunities for BCE.