Isn't it typically done with Vulkan, because apps don't know which library you wanted to use later? On a multi-gpu system you may want to switch (for example) Intel/NVIDIA implementation at runtime rather than linking directly.

That's the point of ICDs. That's why you link to e.g. vulkan-loader instead of directly to the driver library.