My biggest pet peeve with macOS Music is that you can't go back a track in the "infinite play" mode. Not only can you not go back to the previous track, but you can't even go back to the beginning of the song - the button is just greyed out. It's a purely arbitrary limitation because the same functionality works fine in iOS.

I don't know why it bugs me so much, but I'm at the point of moving my library into a self-hosted Navidrome instance so I can stop using Music.