The simulator is a different SDK target than iOS itself.

You have to compile completely independently for it, and depending on your dependencies they may not compile for the simulator.

Additionally the simulator runs a really ancient and feature restricted version of Metal. That means you can’t test a lot of graphical things that the hardware actually supports. I’m not sure if this supports GPU passthrough but the macOS VMs do, so that alone would be a huge improvement if possible.