feat(tests): XML report with format#685
Merged
grooverdan merged 6 commits intoApr 7, 2026
Merged
Conversation
grooverdan
reviewed
Apr 7, 2026
Member
grooverdan
left a comment
grooverdan
left a comment
There was a problem hiding this comment.
Thanks so much for writing this.
I wasn't going to use it for github workflows, just for the buildbot per quick drat - MariaDB/buildbot#945. Can you omit the workflows change for now.
| ;; | ||
| --xml) | ||
| xml_enabled=1 | ||
| if [ $# -gt 1 ] && [ -n "$image" ] && [[ "$2" != -* ]]; then |
Member
There was a problem hiding this comment.
$ mariadb-docker/.test/run.sh --xml /tmp/x.xml mariadb:latest
Error response from daemon: failed to find image tmp/x.xml: docker.io/tmp/x.xml: No such image
Its messy parsing this. Happy to just have the --xml=file.xml + --xml (and no args) syntax.
|
|
||
| escaped_name="$(xml_escape "$name")" | ||
| escaped_classname="$(xml_escape "$classname")" | ||
| escaped_combinations="$(xml_escape "$image")" |
Member
There was a problem hiding this comment.
combinations where a MTR concept where the same test was run with a different set of parameters. It can be omitted from this.
Member
|
Thanks for the quick update. I'll get some interop testing done in the next few days. |
Member
|
Thank you very much @Times-Z ! |
grooverdan
added a commit
to grooverdan/mariadb-buildbot
that referenced
this pull request
Apr 7, 2026
Use the xml form of .test/run.sh to generate a cross reference result. (MariaDB/mariadb-docker#685) If the healthcheck fails on CR, produce a warning (exit 2). Other errors are BB errors.
RazvanLiviuVarzaru
pushed a commit
to MariaDB/buildbot
that referenced
this pull request
Apr 14, 2026
Use the xml form of .test/run.sh to generate a cross reference result. (MariaDB/mariadb-docker#685) If the healthcheck fails on CR, produce a warning (exit 2). Other errors are BB errors.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
resolve #684
I created the XML format based on the example provided
I wasn't entirely sure what the
combinationsfield was for, so I used it to store the name of the tested imageHere is an example of an XML where all tests passed, and another where a test failed
mtr-report_failed.xml
mtr-report_passed.xml
EDIT: Added it to the CI job artifacts as well, so you can see every run job