But can't you continue to run older bytecode versions on newer JVMs? I think you can also specify the source version separately.

Yes, you can. There is no need to recompile, unless you're interested in new language features.

Maintaining binary compatibility is a principal goal of the platform which continues to constrain design decisions for all future changes.