Renaming the class name in the VisualStudio Code leads a new Script in the Unity Editor

Steps to Repro:

1. Create a new Project
2. Create a new Script in the Project > Assets > right-click > Create > C# Script
3. Open Script by double click on it to open in VS Code Editor
2. Change Script name to AAA in Unity Editor
3. Change Script's class name to AAA in VS and save and come back to Unity Editor

Expected Result:
Changes in Scripting is saved successfully

Actual Result:
One new Script is created

Reproducible on: 2020.2.0a13, 2020.2.0a8 , 2020.1.0b11, 2020.1.0b6

Working fine on: 2020.1.0a7, 2020.1.0b5, 2019.3.15f1, 2019.2.12f1, 2019.1.14f1, 2018.4.22f1, 2017.4.40f1

Environment: Windows 10 only

Workaround: Visual Studio Code Editor package downgraded to 1.1.4 works fine