Browser version numbers are in the hundreds and it doesn't seem to be a problem.

Indeed! I think both 0-based versioning, and this (maybe?) downside I bring up addresses the tension between wanting to limit the damage caused by breaking changes with retaining the ability to make them.