Skip to content

Clarify PR testing guidance - #14272

Merged
williammartin merged 1 commit into
trunkfrom
williammartin-truthful-pr-testing
Aug 27, 2026
Merged

Clarify PR testing guidance#14272
williammartin merged 1 commit into
trunkfrom
williammartin-truthful-pr-testing

Conversation

@williammartin

Copy link
Copy Markdown
Member

Description

PR testing descriptions can make expected behavior look like behavior the author actually observed. This updates the How did you test this change? guidance to require factual first-person accounts of performed actions and observed results, while directing authors to write Not tested with an explanation when they did not exercise the changed behavior.

How did you test this change?

Not tested. This documentation-only change does not alter gh runtime behavior. I reviewed the final diff and confirmed that it changes only the testing guidance in the pull request template.

Key points

The change keeps Given/When/Then available for executed scenarios, changes its example to factual past tense, and explicitly excludes planned, hypothetical, inferred, and expected scenarios from reported testing.

Notes for reviewers

Review the How did you test this change? guidance in .github/PULL_REQUEST_TEMPLATE.md. PRs #14271 and #14252 provide the motivating context for distinguishing observed behavior from expected behavior.

Authorship and follow-up

Who wrote this:

  • A human wrote it.
  • An agent wrote it under close human direction.
  • An agent wrote it independently, and no human has guided the implementation beyond the initial prompt.

Who answers review comments:

  • @williammartin will read and reply directly. Name the account.
  • An agent will draft replies and @username will read them before they are posted.
  • Nobody has explicitly committed to replying.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings August 27, 2026 10:23

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Clarifies pull request testing guidance to distinguish observed behavior from expected scenarios.

Changes:

  • Requires factual, first-person testing accounts.
  • Adds explicit Not tested guidance.
  • Updates Given/When/Then examples to past tense.
Show a summary per file
File Description
.github/PULL_REQUEST_TEMPLATE.md Clarifies acceptable testing evidence for pull requests.

Review details

💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

  • Files reviewed: 1/1 changed files
  • Comments generated: 0
  • Review effort level: Balanced

@williammartin
williammartin marked this pull request as ready for review August 27, 2026 10:24
@williammartin
williammartin requested a review from a team as a code owner August 27, 2026 10:24
@williammartin
williammartin requested review from BagToad and a balanced review from Copilot August 27, 2026 10:24

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review details

  • Files reviewed: 1/1 changed files
  • Comments generated: 0 new
  • Review effort level: Balanced

@williammartin
williammartin merged commit e248b92 into trunk Aug 27, 2026
22 checks passed
@williammartin
williammartin deleted the williammartin-truthful-pr-testing branch August 27, 2026 10:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants