Skip to content

Repair wp/6.2 branch Actions: Remove the unused flaky test report uploads and reporter - #85106

Open
desrosj wants to merge 2 commits into
fix-actions-6.2/set-artifact-retention-daysfrom
fix-actions-6.2/remove-flaky-test-report-leftovers
Open

desrosj wants to merge 2 commits into
fix-actions-6.2/set-artifact-retention-daysfrom
fix-actions-6.2/remove-flaky-test-report-leftovers

Conversation

@desrosj

@desrosj desrosj commented Oct 19, 2026

Copy link
Copy Markdown
Member

Part of #82931.

What?

Removes the flaky test reporting pieces that nothing uses any more:

  • .github/workflows/end2end-test.yml: removes both "Archive flaky tests report" steps (the Puppeteer and Playwright jobs).
  • test/e2e/playwright.config.ts: drops ./config/flaky-tests-reporter.ts from the CI reporters, leaving github, and deletes test/e2e/config/flaky-tests-reporter.ts.
  • docs/contributors/code/testing-overview.md: no longer says flaky tests are reported to GitHub issues. The retry sentence stays: CI still retries failed tests twice.

Why?

#84220 removed the report-to-issues job, the only thing that read the flaky-tests-report artifact and filed [Type] Flaky Test issues. The pieces that produce that artifact stayed, so every e2e run in which a test passes on retry still writes flaky-tests/*.json and uploads it, and nothing reads it.

How?

The changes sit at the top of the stack so no other PR needs rebasing. No package changes. Left in place:

  • The Puppeteer reporter (packages/e2e-tests/config/flaky-tests-reporter.js), its entry in packages/e2e-tests/jest.config.js and the comment about it in setup-test-framework.js. They're part of the published @wordpress/e2e-tests package. Without the upload step, its files stay on the runner.
  • packages/report-flaky-tests. Nothing runs the action any more, but removing the package changes package.json, tsconfig.json and package-lock.json.

Use of AI Tools

This PR was created by Claude Code under my supervision. All code should be treated as AI-produced and not yet reviewed by a human until this PR is marked Ready for Review.

🤖 Generated with Claude Code

@desrosj desrosj added the [Type] Build Tooling Issues or PRs related to build tooling label Oct 19, 2026
@desrosj desrosj self-assigned this Oct 19, 2026
@coderabbitai

coderabbitai Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 849ab069-bc3e-45eb-a9d8-aa21c62e168a

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@desrosj
desrosj marked this pull request as ready for review October 19, 2026 17:03
@github-actions

Copy link
Copy Markdown

The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the props-bot label.

If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message.

Co-authored-by: desrosj <desrosj@git.wordpress.org>

To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook.

@desrosj
desrosj removed this pull request from stack #84484 October 21, 2026 19:44
@desrosj
desrosj added this pull request to stack #85344 October 21, 2026 19:45

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

[Type] Build Tooling Issues or PRs related to build tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants