diff --git a/.github/PULL_REQUEST_TEMPLATE.md b/.github/PULL_REQUEST_TEMPLATE.md new file mode 100644 index 00000000..ab6813e3 --- /dev/null +++ b/.github/PULL_REQUEST_TEMPLATE.md @@ -0,0 +1,61 @@ +## What kind of change does this PR introduce? + +New eval, new experiment, scorer fix, framework change, docs update, ... + +## What is the current behavior? + +Please link any relevant issues here. + +## What is the new behavior? + +Feel free to include screenshots if it includes visual changes. + +## How to Review + + + +1. **Review area** + - `path/to/file` + - What to follow or verify. + +2. **Next review area** + - `path/to/next-file` + - What to follow or verify. + +**Review questions** + + + +- [ ] Is the change scoped, and does the behavior match the description? +- [ ] Are edge cases and failure paths handled safely? + + + +## Verification + + + +For new or changed evals (see [CONTRIBUTING.md](/supabase/evals/blob/main/CONTRIBUTING.md)): + +- [ ] Ran the eval locally to sanity check it completes without framework errors. +- [ ] Refreshed results in CI (`run-evals-changed` / `run-evals` labels, or the Refresh eval results workflow) and included them so a reviewer can see results directly. + +## Additional context + +Add any other context or screenshots.