Skip to content

[3.6] bpo-30523, bpo-30764, bpo-30776: Sync regrtest from master #2441

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jun 27, 2017
Merged

[3.6] bpo-30523, bpo-30764, bpo-30776: Sync regrtest from master #2441

merged 3 commits into from
Jun 27, 2017

Conversation

vstinner
Copy link
Member

vstinner added 3 commits June 27, 2017 15:47
@vstinner
bpo-30523: regrtest --list-cases --match (#2401)
6bc5668 
* regrtest --list-cases now supports --match and --match-file options.
  Example: ./python -m test --list-cases -m FileTests test_os
* --list-cases now also sets support.verbose to False to prevent
  messages to stdout when loading test modules.
* Add support._match_test() private function.
(cherry picked from commit ace56d5)
@vstinner
bpo-30764: regrtest: add --fail-env-changed option (#2402)
2e92628 
* bpo-30764: regrtest: change exit code on failure

* Exit code 2 if failed tests ("bad")
* Exit code 3 if interrupted

* bpo-30764: regrtest: add --fail-env-changed option

If the option is set, mark a test as failed if it alters the
environment, for example if it creates a file without removing it.

(cherry picked from commit 63f54c6)
@vstinner
bpo-30776: reduce regrtest -R false positives (#2422)
40590e4 
* Change the regrtest --huntrleaks checker to decide if a test file
  leaks or not. Require that each run leaks at least 1 reference.
* Warmup runs are now completely ignored: ignored in the checker test
  and not used anymore to compute the sum.
* Add an unit test for a reference leak.

Example of reference differences previously considered a failure
(leak) and now considered as success (success, no leak):

    [3, 0, 0]
    [0, 1, 0]
    [8, -8, 1]
(cherry picked from commit 48b5c42)
@vstinner vstinner merged commit 35d2ca2 into python:3.6 Jun 27, 2017
@vstinner vstinner deleted the regrtest36 branch June 27, 2017 14:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vstinner @the-knights-who-say-ni