Files

T

Rodin 8cfabfdc55 experiment #32 : testability analysis — new analytical lens

Tested GPT-5, Opus, Sonnet on wash-sale-tracking.md spec.
Opus found a genuine spec bug (trigger logic described backwards).
Confirms pattern: GPT-5 for breadth, Opus for logic contradictions,
Sonnet adds no value for systematic analytical tasks.

2026-05-06 10:09:05 -07:00

2026-04-26-01-different-models-catch-different-things.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-02-cheap-model-narrow-lens-expensive.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-03-gpt5-times-out-on-complex.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-04-gpt5-defaults-to-delegation-claude.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-05-sonnet-is-fast-and-catches.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-06-single-agent-cant-handle-1000.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-26-07-emerging-role-assignments-pattern-not.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-04-27-08-bias-detection-all-models-catch.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-02-09-gapfinding-in-architecture-docs-gpt5.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-02-10-hiddenassumption-identification-gpt5s-reasoning-produces.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-02-11-hiddenassumption-identification-on-simpler-doc.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-02-12-sonnet-46-outperforms-expectations-on.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-03-07b-token-budget-matters-more-than.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-03-13-race-condition-identification-opus-excels.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-03-14-crosscomponent-interaction-analysis-gpt5-mini.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-03-15-design-coherence-analysis.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-03-16-specification-completeness-sonnet-45-produces.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-04-18-temporal-boundary-analysis-gpt5-is.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-04-19-union-coverage-test-gpt5-mini.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-04-20-invariant-violation-path-analysis-gpt5.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-04-21-reasoning-effort-lowmediumhigh-has-negligible.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-22-silent-correctness-failures-new-analytical.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-23-regulatory-compliance-analysis-gpt5-finds.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-24-design-improvement-proposals-gpt5-excels.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-25-contradiction-detection-new-task-type.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-26-missingfeature-identification-is-promptable-across.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-27-design-coherence-on-riskcontrolsmd-gpt5.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-28-crossdocument-consistency-analysis-new-task.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-05-29-adversarial-manipulation-analysis-new-task.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

2026-05-06-31-spec-gap-analysis-continuous-risk-monitoring.md

finding #31 : spec-gap analysis on continuous-risk-monitoring.md

2026-05-06 08:27:00 -07:00

2026-05-06-32-testability-analysis-wash-sale-tracking.md

experiment #32 : testability analysis — new analytical lens

2026-05-06 10:09:05 -07:00

README.md

refactor(findings): split ALL-FINDINGS.md into per-experiment files

2026-05-06 07:15:50 -07:00

README.md

Model Findings — Analytical & Research Work

Tracking what actually works (and doesn't) when using AI models for research, analysis, bias detection, and document review — not coding.

Started: 2026-04-26

Context

We use multiple models in different roles: Claude Code (Opus/Sonnet) for generation, Sonnet + GPT-5 for independent dual review, smaller models for focused analytical tasks. Most public discussion is about coding. We found almost no published methodology for using models in analytical research tasks (searched 2026-04-26). That gap is why we're tracking this.

Each experiment lives in its own file. See individual finding files below.