Code lenses don't work after opening files from different projects in workspace

[DanielFEvans]

I believe the Python extension is the correct place to report this, but it's difficult to tell which of the possible core/extension features is actually at fault.

Environment data

• VS Code version: 1.47.0
• Extension version (available under the Extensions sidebar): 2020.6.91350
• OS and version: Windows 10, running remotely on Scientific Linux 7.6
• Python version (& distribution if applicable, e.g. Anaconda): Python 3.6.8, from OS.
• Type of virtual environment used (N/A | venv | virtualenv | conda | ...): virtualenv.
• Relevant/affected Python packages and their versions: Unittest (Py3.6 standard library), nose (1.3.7)
• Relevant/affected Python-related VS Code extensions and their versions: Remote - SSH 0.51.0
• Value of the python.languageServer setting: Microsoft

Expected behaviour

When I have a workspace with multiple project folders, I should be able to open files from multiple projects without losing test annotations (Run Test / Debug Test).

Note that I am running remotely on a Linux machine from Windows; I don't know if the same issue occurs locally.

Actual behaviour

After opening a file from one project folder, and then opening a file from a second project folder, test annotations no longer work.

Steps to reproduce:

Small example containing two project folders, with a single test in each:
vscode_python_test_issue.zip

1. Extract example zip file
2. Create new workspace
3. Add project_1 directory to workspace
4. Add project_2 directory to workspace
5. Open project_1/src/tests/test_func1.py
6. Discover python tests in project_1

Run Test/Debug Test annotations should appear on screen. Running the test works, etc.

7. Open project_2/src/tests/test_magic.py (or any other file in project_2)
8. Return to test_func1.py

Test annotations we saw earlier will now disappear.

9. Discover tests in project_2 (if not done automatically)

No test annotations appear in either test_func1.py or test_magic.py.

10. Close test_magic.py

Test annotations in test_func1.py do not reappear, even if one tries rediscover tests, etc.

11. Use VSCode "Reload Window" function, or close and reopen fully.

Test annotations appear in test_func1.py again, but will disappear if anything from project_2 is opened.

This behaviour can also be observed by opening the project_2 tests first and then opening project_1. It also occurs if non-test files are opened - e.g. open func1.py in project 1, open magic.py from project 2, then open any test file.

Logs

I have not observed any unusual behaviour in the "Python Test Log". Let me know if any of the (many!) other logs are worth inspecting.

[karrtikr]

Unfortunately we have noticed that there are some other extensions which may interfere with Codelens, for eg. Liveshare. Please try disabling the other extensions one by one and see which one is causing the issue.

[DanielFEvans]

The issue still occurs with all extensions bar Python disabled (locally on Windows 10), or with just Python + Remote-SSH (remotely on Linux).

[karrtikr]

Thanks for the bug report, I am able to reproduce this issue.