Yeah, I did that. I think the problem is when there are multiple singers harmonizing it only removes one.

indeed! the stem separation model is not ideal. you can try to change the stem separation model in the settings and reanalyze the song (make sure to click the trash button and then analyze, refresh button does not refresh the stems, only the transcript/alignment)