The main problem I have with the language is compile times. Rust is good at many things, but not that.
Xcode is optional, though its primacy has meant less adoption of Swift's first party LSP and VS Code extension.