Skip to content

Show incremental progress when running tests #6407

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tdamsma opened this issue Jul 2, 2019 · 16 comments
Closed

Show incremental progress when running tests #6407

tdamsma opened this issue Jul 2, 2019 · 16 comments
Assignees
Labels
area-testing feature-request Request for new features or functionality

Comments

@tdamsma
Copy link

tdamsma commented Jul 2, 2019

When running many tests from the TEST:PYTHON sidebar, all tests are shown to be in progresss (spinning arrow) until all tests have been run.

It would be much nicer if the spinning arrow icon is updated as soon has the test has run. In the Python Test Log this information is readily available, so you can directly see which tests have passed, failed, are running now or are scheduled to be run.

Possibly related to #1718, but that is more about the spinner in the bottom bar

@tdamsma tdamsma added triage-needed Needs assignment to the proper sub-team feature-request Request for new features or functionality labels Jul 2, 2019
@ghost ghost removed the triage-needed Needs assignment to the proper sub-team label Jul 2, 2019
@MarekOzana
Copy link

Is there any progress on this one? One needs to run all tests before discovering that any test failed. See below how PyCharm reports progress:
pycharm-pytest-progress
Thank you for your time.

@jahan01
Copy link

jahan01 commented Jan 4, 2020

the real time updates to individual test's status was working in https://marketplace.visualstudio.com/items?itemName=LittleFoxTeam.vscode-python-test-adapter. I had used this extension before the MS python extension provided its own implementation of Test explorer

@brettcannon
Copy link
Member

We are going through old issues and we noticed that no one from the team had replied to this issue. I want to apologize for the oversight and to let you know that the issue was reviewed by the team and triaged (as shown by the labels applied to this issue).

@MarekOzana
Copy link

Thanks @brettcannon

@ItamarShDev
Copy link

This would be a major improvement. waiting for 100+ tests to finish before being able to know what failed is a big pain

@karrtikr karrtikr added the verification-found Issue verification failed label Jul 29, 2021
@karrtikr
Copy link

karrtikr commented Jul 29, 2021

Fixed by #16769 but only for unittest framework, not pytest.

@karrtikr karrtikr added verified Verification succeeded verification-found Issue verification failed and removed verification-found Issue verification failed verified Verification succeeded labels Jul 29, 2021
@karthiknadig
Copy link
Member

This will be done with the test adapter improvements for pytest. The UI itself now handles individual test progress.

@karthiknadig karthiknadig removed the verification-found Issue verification failed label Jul 30, 2021
@ItamarShDev
Copy link

his will be done with the test adapter improvements for pytest. The UI itself now handles individual test progress.

Can you please give us an update about the adapter status?

@fsteinmetz
Copy link

It's great to see the improvements in the test area !!
The incremental test progress seems to work, but not always. When launching parametrized pytests through the gutter button, I see incremental status appearing. In the explorer, I can also click several tests, one by one, which are run in parallel with incremental progress. However, when running all tests in a file or in a project, the status only appears when all tests are done.

@ItamarShDev
Copy link

ItamarShDev commented Sep 14, 2021 via email

@DmytroSokhach
Copy link

This will be done with the test adapter improvements for pytest. The UI itself now handles individual test progress.

Is there a specific area or issue exist for Test Adapter? Could you link it here please as all searches end up with current ticket.

@karthiknadig
Copy link
Member

@DmytroSokhach #17242 item tracks the progress on the test adapter re-write.

@github-actions github-actions bot removed the needs PR label Aug 9, 2022
@karrtikr karrtikr added the needs PR Ready to be worked on label Aug 9, 2022
@geomlyd
Copy link

geomlyd commented Jun 22, 2023

Has this been solved? I can't really see any sort of progress indication on parameterized pytests, and it is fairly frustrating when there's many of them and they take some time to run...

@eleanorjboyd eleanorjboyd self-assigned this Jun 22, 2023
@eleanorjboyd
Copy link
Member

Hello! This will soon be a feature following our testing rewrite. Our rewrite is out on insiders using the setting "python.experiments.optInto": ["pythonTestAdapter"],. Once this PR is merged: #21466 and you enable the rewrite, this feature will work. The rewrite will progressively be shipped to more customers as we are shifting all users to the rewrite but are in the incremental stages at the moment.

@ItamarShDev
Copy link

ItamarShDev commented Jun 22, 2023 via email

@eleanorjboyd
Copy link
Member

this is now out on stable with the experiment turned on and therefore I am closing this as resolved. Thanks!

@github-actions github-actions bot removed the needs PR Ready to be worked on label Jul 14, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 14, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-testing feature-request Request for new features or functionality
Projects
None yet
Development

No branches or pull requests