If you want to use a really Open Source alternative to VS Code without telemetry, just install VS Codium.

https://vscodium.com/