> Imagine, for example, if the JVM needed a bunch of JEPs for JIT improvements.

They do:

https://openjdk.org/jeps/197

https://openjdk.org/jeps/515

Not every optimization requires a JEP, but certainly something as big as "add or remove a JIT" would 100% require a JEP.