-
Notifications
You must be signed in to change notification settings - Fork 102
Conversation
Based on the icount, it looks like
|
I am collecting a baseline for extensive test runtime at #471. Think I might just need to turn down the test iterations here unless there are some obvious perf wins. Edit: the |
7bcc6d7
to
513aa00
Compare
Certain functions (`fmodf128`) are significantly slower than others, to the point that running the default number of tests adds tens of minutes to PR CI and extensive test time increases to ~1day. It does not make sense to do this by default; so, introduce `EXTREMELY_SLOW_TESTS` to test configuration that allows setting specific tests that need to have a reduced iteration count.
This function is significantly slower than all others so includes an override in `EXTREMELY_SLOW_TESTS`. Without it, PR CI takes ~1hour and the extensive tests in CI take ~1day.
Seems like this is more or less expected. I added a way to override the default number of iterations to make sure tests don't just run forever. |
With the override, extensive tests complete in 12 minutes and normal PR CI looks about the same. Seems reasonable 🎉 |
This function is significantly slower than all others so includes an override in
EXTREMELY_SLOW_TESTS
. Without it, PR CI takes ~1hour and the extensive tests in CI take ~1day.