Repository navigation
Random image failures with test_curvelinear4 #10602
Description
We are getting frequent but inconsistent failures on Travis:
FAIL lib/mpl_toolkits/tests/test_axisartist_floating_axes.py::test_curvelinear4[png]
e.g., https://travis-ci.org/matplotlib/matplotlib/jobs/346056502
Activity
QuLogic commentedon Feb 26, 2018
Also seems to affect AppVeyor, e.g., #10426 failed but then worked on rebuild.
efiring commentedon Feb 26, 2018
The Travis output indicates that we should be able to download the result images as a tarball, but I haven't been able to access the given URL. Is there some trick to it?
efiring commentedon Feb 26, 2018
In 2 examples, one from Travis and the other from Appveyor, the mismatch is 0.011, but the tolerance is 0.01. My guess is that there has always been something slightly non-deterministic in this test, and whatever it is, it has simply gotten slightly worse. In the spirit of triage, I think we should just bump the tolerance to 0.02 and move on. Tracking down the root cause is probably not the best use of anyone's time right now.
QuLogic commentedon Feb 26, 2018
Yes, when I transferred those examples from the source files into real tests, they were always a bit flaky, and I was always hopeful that things like #10403 will help with it (e.g., I've just noticed that
set_axes_locatorin the toolkit version does not setAxes.stale.)Bump a tolerance in test_axisartist_floating_axes.