The mistake in your argument is thinking that buying batteries results directly in e-waste. It first results in more working batteries being used over the lifetime of a device. Whether that results in more or less waste batteries in wallclock time depends on how that affects the time the device is used. If batteries are also standardized and thus device independent, the device becoming waste also doesn't mean the battery becoming waste automatically.

But yeah, I can see the irony in my comment.