The other problem with Slack is that it just straight up... doesn't do what you tell it to. I have a set of notification settings that work for me. Slack goes ahead and just does something else, and you simply can't fix it to do what it's told. (Or couldn't, anyway; I've been off Slack for a while.)