If you want to ship a prebuilt binary that'll run on any linux distro you need to statically link libc and musl is by far the easiest way to do that.

except it only can work for CLI apps or anything that doesn't use the GPU as for instance nvidia drivers require glibc