Swift uses garbage collection (I know, arc, but that's still garbage collection)

That’s simply not true, starting with ARC being compile-time and GC being run-time.

Reference counting very much incurs a runtime cost; it's not just a compile time abstraction, like borrow-checking in Rust.