This is, indeed, an issue. IIRC, the only interchangeable disk format with CP/M was with 8 inch media.

Unless the disks had copy protection, you could copy them over a serial link. I did that a lot between my Apple II and other CP/M machines.