Skip to content

CI: flaky hypothesis #24700

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jreback opened this issue Jan 10, 2019 · 2 comments · Fixed by #24701
Closed

CI: flaky hypothesis #24700

jreback opened this issue Jan 10, 2019 · 2 comments · Fixed by #24701
Labels
CI Continuous Integration good first issue
Milestone

Comments

@jreback
Copy link
Contributor

jreback commented Jan 10, 2019

similar to #24641 need to add deadline=None, simliar to #24654

=================================== FAILURES ===================================
___________________________ test_tick_equality[Hour] ___________________________
[gw0] linux -- Python 3.6.6 /home/travis/miniconda3/envs/pandas-dev/bin/python
cls = <class 'pandas.tseries.offsets.Hour'>
    @pytest.mark.parametrize('cls', tick_classes)
>   @example(n=2, m=3)
    @given(n=st.integers(-999, 999), m=st.integers(-999, 999))
    def test_tick_equality(cls, n, m):
pandas/tests/tseries/offsets/test_ticks.py:62: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../../miniconda3/envs/pandas-dev/lib/python3.6/site-packages/hypothesis/core.py:638: in execute
    ) % (test.__name__, text_repr[0],))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
self = <hypothesis.core.StateForActualGivenExecution object at 0x7f03caa41710>
message = 'Hypothesis test_tick_equality(cls=Hour, n=516, m=-209) produces unreliable results: Falsified on the first call but did not on a subsequent one'
    def __flaky(self, message):
        if len(self.falsifying_examples) <= 1:
>           raise Flaky(message)
E           hypothesis.errors.Flaky: Hypothesis test_tick_equality(cls=Hour, n=516, m=-209) produces unreliable results: Falsified on the first call but did not on a subsequent one
../../../miniconda3/envs/pandas-dev/lib/python3.6/site-packages/hypothesis/core.py:884: Flaky
---------------------------------- Hypothesis ----------------------------------
Falsifying example: test_tick_equality(cls=Hour, n=516, m=-209)
Unreliable test timings! On an initial run, this test took 1640.87ms, which exceeded the deadline of 500.00ms, but on a subsequent run it took 0.30 ms, which did not. If you expect this sort of variability in your test timings, consider turning deadlines off for this test by setting deadline=None.
=============================== warnings summary ===============================
@jreback jreback added CI Continuous Integration good first issue labels Jan 10, 2019
@jreback jreback added this to the Contributions Welcome milestone Jan 10, 2019
@rajibmitra
Copy link
Contributor

I am doing this , thanks for opening this issue.

@rajibmitra rajibmitra mentioned this issue Jan 10, 2019
3 tasks
@jreback jreback modified the milestones: Contributions Welcome, 0.24.0 Jan 10, 2019
@rajibmitra
Copy link
Contributor

#24701 is that ok ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration good first issue
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants