fix: repair unescaped quotes in LLM JSON responses #45

Merged

rodin merged 3 commits from fix/json-repair into main 2026-05-05 12:40:39 +00:00

Conversation 9 Commits 3 Files Changed 2

+343 -1

3 Commits

Author	SHA1	Message	Date
Rodin	489457c184	ci: retrigger after LLM_BASE_URL secret fix	2026-05-04 23:15:08 -07:00
Rodin	25d1a670bf	fix: redesign repairJSON to handle all reviewer-reported edge cases ... Rewrites the JSON repair algorithm to address two correctness bugs identified in code review: 1. Interior quoted word before comma: "say "yes", and go" was misidentified as structural close because "," followed the quote. 2. JSON-shaped content in strings: {"key": "val"} inside a string value was being parsed as actual JSON structure. The new approach: - Distinguishes keys from values (only values need repair) - Uses first-valid-candidate scan with deep lookahead - Verifies that after a candidate close, the continuation is not just a structural char but a complete valid JSON pattern - Validates keyword tokens (true/false/null) fully, not just first char - Checks container closes recursively for valid continuation Adds comprehensive tests for all reported edge cases plus a complex combined scenario with nested JSON-like content, quoted words before commas, and multiple failure modes in one string.	2026-05-04 21:27:39 -07:00
Rodin	80a9a7675b	fix: repair unescaped quotes in LLM JSON responses ... LLMs (especially Sonnet) sometimes emit JSON with unescaped double quotes inside string values, e.g. (e.g. "28") instead of properly escaping them. This caused parse failures in CI. Add a repairJSON fallback that uses a character-by-character scanner to identify interior quotes (those not followed by structural JSON characters) and escape them before retrying the parse. Fixes sonnet-review failures on gargoyle PR #551.	2026-05-03 09:47:22 -07:00