It’s not about that, exactly.

If you need to grab the phone every time you change songs it’s likely you’ll check notifications or something of the sort.

The same goes for going for a walk with music but not the phone, to be unreachable. You could use airplane mode but there’s value in the added friction.