Skip to content

Conversation

@dylan-hurd-oai
Copy link
Collaborator

Summary

Consolidates our apply_patch tests into one suite, and ensures each test case tests the various ways the harness supports apply_patch:

  1. Freeform custom tool call
  2. JSON function tool
  3. Simple shell call
  4. Heredoc shell call

There are a few test cases that are specific to a particular variant, I've left those alone.

Testing

  • This adds a significant number of tests

| ApplyPatchModelOutput::Shell
| ApplyPatchModelOutput::ShellViaHeredoc => self.function_call_stdout(call_id).await,
}
}
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I know it's not ideal to expand the scope of the harness, but this felt significantly simpler than introducing async function type signatures / closures in the apply_patch test suite

chatgpt-codex-connector[bot]

This comment was marked as resolved.

@dylan-hurd-oai dylan-hurd-oai force-pushed the dh--refactor-apply-patch-tests branch from 60360dc to 893822e Compare November 12, 2025 19:04
@dylan-hurd-oai dylan-hurd-oai force-pushed the dh--refactor-apply-patch-tests branch 2 times, most recently from bfa73b2 to 0e3cf67 Compare November 13, 2025 20:07
@dylan-hurd-oai dylan-hurd-oai merged commit 2c1b693 into main Nov 13, 2025
25 checks passed
@dylan-hurd-oai dylan-hurd-oai deleted the dh--refactor-apply-patch-tests branch November 13, 2025 23:52
@github-actions github-actions bot locked and limited conversation to collaborators Nov 13, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants