Skip to content

New test driver #907

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JukkaL opened this issue Oct 11, 2015 · 0 comments
Closed

New test driver #907

JukkaL opened this issue Oct 11, 2015 · 0 comments
Labels

Comments

@JukkaL
Copy link
Collaborator

JukkaL commented Oct 11, 2015

I just merged #721 (by @o11c) which replaces the old test driver tests.py and the travis script. I'm creating this issue to increase visibility to contributors.

Summary of main workflow changes:

  • Run all unit tests via ./runtests.py unit-test (this was python3 tests.py previously).
  • Run all tests (similar to the previous travis script but with better coverage) via ./runtests.py.
  • You can't run unit tests via python3 -m mypy.test.testcheck (etc.) any more.

The readme contains more examples of how to run tests. Also try ./runtests.py -h.

The new driver is better than the old one in several respects. These are some of biggest wins:

  • Tests are run in parallel. (Though inidividual suites are still run on a single cpu and not parallelized.)
  • All stubs are automatically type checked (previously some were not tested and the test configuration was more fragile).
  • There is more test auto discovery.
  • There is a single entry point to all tests that also supports filtering.

Test output is not great right now and needs some love, but I merged it anyway as the PR has been open for a long time and there was much grumbling (sorry!).

@JukkaL JukkaL added the feature label Oct 11, 2015
@JukkaL JukkaL closed this as completed Oct 11, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant