Make REQUEST_CHANGES threshold configurable #15

Closed
opened 2026-05-01 19:47:20 +00:00 by rodin · 1 comment
Owner

Problem

Currently the threshold is hardcoded in the system prompt: any MAJOR finding → REQUEST_CHANGES, no MAJORs → APPROVE. Different teams may want different thresholds.

Proposed Solution

Add a --threshold / REVIEW_THRESHOLD option with values like:

  • strict — any finding (MAJOR, MINOR, or NIT) triggers REQUEST_CHANGES
  • major — only MAJOR findings trigger REQUEST_CHANGES (current default)
  • lenient — never REQUEST_CHANGES, always APPROVE with findings noted

The threshold is injected into the system prompt rules section.

Use Cases

  • strict: gargoyle (zero findings policy)
  • major: general repos (only block on real issues)
  • lenient: early-stage repos where reviews are advisory only
## Problem Currently the threshold is hardcoded in the system prompt: any MAJOR finding → REQUEST_CHANGES, no MAJORs → APPROVE. Different teams may want different thresholds. ## Proposed Solution Add a `--threshold` / `REVIEW_THRESHOLD` option with values like: - `strict` — any finding (MAJOR, MINOR, or NIT) triggers REQUEST_CHANGES - `major` — only MAJOR findings trigger REQUEST_CHANGES (current default) - `lenient` — never REQUEST_CHANGES, always APPROVE with findings noted The threshold is injected into the system prompt rules section. ## Use Cases - **strict**: gargoyle (zero findings policy) - **major**: general repos (only block on real issues) - **lenient**: early-stage repos where reviews are advisory only
Author
Owner

Closing — this is configurable via --system-prompt-file. The default prompt defines the threshold ("any MAJOR → REQUEST_CHANGES"), and per-repo overrides can redefine severity rules. No code change needed.

Closing — this is configurable via `--system-prompt-file`. The default prompt defines the threshold ("any MAJOR → REQUEST_CHANGES"), and per-repo overrides can redefine severity rules. No code change needed.
rodin closed this issue 2026-05-02 19:08:00 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: rodin/review-bot#15