but for x86_64, as of right now, if only a single call needs more than 31bits you have to upgrade the whole code section to large code model.

BOLT AFAIU is more about cache locality of putting hot code near each other and not really breaking the 2GiB barrier.

Why? Can't the linker or post-link optimizer reduce all near calls, leaving the more complicated mov with immediate form only where required?