Have you tried replacing your eartips? I find that radically improves performance - I think they must either get clogged or brittle in a way that causes problems.

Cheap foam eartips from Amazon are even better than stock for my AirPods Pro but they need to be replaced more often.