It always seems weird to me how people complain about such things. Just do your thing and don't care about others. If others are blocking you, just say so in the daily or to your manager. Easy.

I don't really care about unproductive people, I care about myself.