Yes, the DLLs are usually installed along with the binary by the installer on Windows.

What I was talking about was the setup required on your machine/CI to get the dependencies to build those DLLs.