Surely I am safe running VSCode on my Linux machine. No chance it would upload a bunch of personal telemetry without my say so.

Use VSCodium. It's the FLOSS branch with Microsoft tracking shit removed.

https://github.com/VSCodium/vscodium