Files
Open_Ultra_SAST/benchmarks/archive/paths.md
T
Marius CiepluchandClaude Opus 5.5 067adb9845 chore(bench): archive reference-only scripts
A1-A3 of the legacy inventory, moved with git mv to benchmarks/archive/:
the stage-2 verifier chain (verify_batched, score_batched, verify_sinks,
model_sinks, sink_candidates), the v2 tool hunter (hunt.py) and the
harnessx-removal equality proof. The plane's verify/agree/roles tasks
replaced the first six; the harnessx-removal spec is closed.

- The six independent scripts keep HERE = benchmarks/independent (population,
  evaluate.py, results) and add their own directory for archived siblings.
- harnessx_removal_equality's REPO root is one level deeper.
- tests/test_plane_scoring_parity.py loads score_batched from the archive
  (ran here, not skipped); test_harnessx_removal_equality points at the new path.
- benchmarks/archive/README.md: what each script was, which committed
  records cite it, the commit that last ran it. paths.md maps old -> new;
  committed records are not rewritten.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo
2026-10-02 08:07:35 +02:00

1.4 KiB

Old path to new path (2026-10-02)

Committed records, specs and some docstrings name these scripts by their old path. Those files are not rewritten. Read the old path as the new one:

old path new path
benchmarks/independent/verify_batched.py benchmarks/archive/verify_batched.py
benchmarks/independent/score_batched.py benchmarks/archive/score_batched.py
benchmarks/independent/verify_sinks.py benchmarks/archive/verify_sinks.py
benchmarks/independent/model_sinks.py benchmarks/archive/model_sinks.py
benchmarks/independent/sink_candidates.py benchmarks/archive/sink_candidates.py
benchmarks/independent/hunt.py benchmarks/archive/hunt.py
benchmarks/harnessx_removal_equality.py benchmarks/archive/harnessx_removal_equality.py

Files that still use the old path:

  • Records: independent/hunter-protocol-v2.md, independent/results-v2-model-pipeline.json, independent/selection-v2-model-sinks.json, independent/verifier-batched-check-2026-09-29.json, measurements/2026-09-30-harnessx-removal-equality/README
  • Specs: .kiro/specs/ai-service-plane/, .kiro/specs/harnessx-removal/design.md, .kiro/specs/learned-decision-engine/
  • Docstrings: src/openultrasast/plane/generate.py, plane/tasks/{verify,agree,roles,repo_facts}.py. These are left for the owners of those packages.