Skip to content

Repair wp/6.3 branch Actions: Remove the unused flaky test report uploads and reporter - #85107

Open
desrosj wants to merge 2 commits into
fix-actions-6.3/set-artifact-retention-daysfrom
fix-actions-6.3/remove-flaky-test-report-leftovers
Open

desrosj wants to merge 2 commits into
fix-actions-6.3/set-artifact-retention-daysfrom
fix-actions-6.3/remove-flaky-test-report-leftovers

Conversation

@desrosj

@desrosj desrosj commented Oct 19, 2026

Copy link
Copy Markdown
Member

Part of #82930.

What?

Removes the flaky test reporting pieces that nothing uses any more:

  • .github/workflows/end2end-test.yml: removes both "Archive flaky tests report" steps (the Puppeteer and Playwright jobs).
  • test/e2e/playwright.config.ts: drops ./config/flaky-tests-reporter.ts from the CI reporters, leaving github, and deletes test/e2e/config/flaky-tests-reporter.ts.
  • docs/contributors/code/testing-overview.md: no longer says flaky tests are reported to GitHub issues. The retry sentence stays: CI still retries failed tests twice.

Why?

#83700 removed the report-to-issues job, the only thing that read the flaky-tests-report artifact and filed [Type] Flaky Test issues. The pieces that produce that artifact stayed, so every e2e run in which a test passes on retry still writes flaky-tests/*.json and uploads it, and nothing reads it.

How?

The changes sit at the top of the stack so no other PR needs rebasing. No package changes. Left in place:

  • The Puppeteer reporter (packages/e2e-tests/config/flaky-tests-reporter.js), its entry in packages/e2e-tests/jest.config.js and the comment about it in setup-test-framework.js. They're part of the published @wordpress/e2e-tests package. Without the upload step, its files stay on the runner.
  • packages/report-flaky-tests. Nothing runs the action any more, but removing the package changes package.json, tsconfig.json and package-lock.json.

Use of AI Tools

This PR was created by Claude Code under my supervision. All code should be treated as AI-produced and not yet reviewed by a human until this PR is marked Ready for Review.

🤖 Generated with Claude Code

@desrosj desrosj added the [Type] Build Tooling Issues or PRs related to build tooling label Oct 19, 2026
@desrosj desrosj self-assigned this Oct 19, 2026
@desrosj
desrosj added this pull request to stack #84482 October 19, 2026 14:36
@coderabbitai

coderabbitai Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: e34e9795-08ef-4ce6-9098-69a0d0eecaee

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

github-actions Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the props-bot label.

If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message.

Co-authored-by: desrosj <desrosj@git.wordpress.org>
Co-authored-by: ramonjd <ramonopoly@git.wordpress.org>

To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook.

@desrosj
desrosj force-pushed the fix-actions-6.3/remove-flaky-test-report-leftovers branch from d7b9f27 to 1cc776d Compare October 19, 2026 17:07
@desrosj
desrosj removed this pull request from stack #84482 October 21, 2026 19:43
@desrosj
desrosj added this pull request to stack #85342 October 21, 2026 19:44
@desrosj
desrosj force-pushed the fix-actions-6.3/remove-flaky-test-report-leftovers branch from 1cc776d to 7304192 Compare October 23, 2026 18:07

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

[Type] Build Tooling Issues or PRs related to build tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants