Skip to content

Improving documentation: Tests failing on a osx setup #7234

Closed

Description

@NelleV

We've ran into some problems getting the matplotlib environment working fine on linux, and I am not sure this is documented anywhere.

We had a massive number of tests failing, as the tests where not running on the correct freetype issue. The fix was easy:

  1. edit the setup.cfg file and set the test to True, and local_freetype to true.
  2. Delete the old build - matplotlib caches the results and will not rebuild with the new options despite they changed.
  3. Rebuild.

Our documentation need to be updated to reflect this issue.

Original issue.

On system python2.7.8, on latest master version, with both the macosx and agg backend, @trpham is having a lot of tests failing on images comparisons:

======================================================================
FAIL: mpl_toolkits.tests.test_axes_grid1.test_inset_locator(0, u'inset_locator', u'png')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Library/Python/2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/Users/TruongPham/BIDS/matplotlib/lib/matplotlib/testing/nose/decorators.py", line 60, in failer
    result = f(*args, **kwargs)
  File "/Users/TruongPham/BIDS/matplotlib/lib/matplotlib/testing/decorators.py", line 297, in compare
    raise_on_image_difference(expected_fname, actual_fname, self.tol)
  File "/Users/TruongPham/BIDS/matplotlib/lib/matplotlib/testing/decorators.py", line 216, in raise_on_image_difference
    '(RMS %(rms).3f)' % err)
ImageComparisonFailure: images not close: /Users/TruongPham/BIDS/matplotlib/result_images/test_axes_grid1/inset_locator.png vs. /Users/TruongPham/BIDS/matplotlib/result_images/test_axes_grid1/inset_locator-expected.png (RMS 0.001)

Around 900 tests are failing, but the RMS is always extremely small. Anyone guesses what is going on?

Apart from this, matplotlib seems to be running fine. Any help would be appreciated.

Activity

  1. NelleV commented on Oct 7, 2016

    @NelleV
    MemberAuthor

    It might be a freetype issue.

  2. NelleV commented on Oct 7, 2016

    @NelleV
    MemberAuthor

    It was a freetype issue.
    I'll document this properly.

  3. changed the title [-]Tests failing on a osx setup[/-] [+]Improving documentation: Tests failing on a osx setup[/+] on Oct 7, 2016
  4. tacaswell commented on Oct 8, 2016

    @tacaswell
    Member

    There is also an enviromental variable.

    Some of this is documented at http://matplotlib.org/devdocs/devel/testing.html#building-matplotlib-for-image-comparison-tests (but does not seem to be in the currently built docs).

  5. NelleV commented on Oct 8, 2016

    @NelleV
    MemberAuthor

    I am working on improving the contributors documentation right now to be able to point to one page for new contributors. I've highly inspired myself from the scikit-learn documentation, and a work in progress can be found here:
    http://cbio.mines-paristech.fr/~nvaroquaux/tmp/matplotlib/devel/contributing.html

  6. added this to the milestone on Nov 2, 2016
  7. added a commit that references this issue on Nov 3, 2016
    02282e1
  8. added 2 commits that reference this issue on Nov 8, 2016
    f2f7741
    3a6083e
  9. modified the milestones: , on Dec 7, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Difficulty: Easyhttps://matplotlib.org/devdocs/devel/contribute.html#good-first-issuesDocumentation

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions