Consumers are ultimately the party responsible for this pollution though, so we should pay.
Paying taxes doesn’t reduce the harm. You can’t change a complex system with one knob.
Raising the cost incentivizes finding alternatives. Your statement would only be true if no alternatives are ever available.