When your country emits more CO2 there’s more CO2 in the atmosphere independent of what anyone else does.

So it’s true each individual country only receives a fraction of the negative impact of their own emissions, but that fraction isn’t zero and therefore should be taxed to maximize economic efficiency. Further joining international treaties to agree to collectively tax carbon at a higher rate representing the harm across all those countries is even more economically efficient.