Marius CiepluchandClaude Fable 5.1 1d1c87f63b bench(valid): a training freeze may cap the history walk at the newest N first-parent commits ...

ordinary_history(limit=) walks only the newest commits; assemble.freeze(history_limit=) and
--history-limit pass it through and the record carries it. The held-out benchmark passes none.
Reason: trigger.dev's 7,109-commit walk runs for hours at the per-commit cost of the function
and generated checks; the training freeze now walks its newest 1,500.

Co-Authored-By: Claude Fable 5.1 <[email protected]>

2026-10-13 20:47:23 +02:00

..

pilot

feat(benchmark): freeze the valid-benchmark pilot, 12 verified positives + 240 negatives

2026-10-12 19:42:45 +02:00

train

data: maintainer spot-check, 51 access control locations accepted (7 changes)

2026-10-13 18:09:10 +02:00

__init__.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

assemble.py

bench(valid): a training freeze may cap the history walk at the newest N first-parent commits

2026-10-13 20:47:23 +02:00

catalog.py

data: hunt training-set candidates (task 4.1), not frozen: 99 verified locations in 28 changes, awaiting spot-check

2026-10-13 16:48:41 +02:00

hunter_arm.py

feat(benchmark): combine --keep-verdicts drops hunter suspicions the classifier rejected

2026-10-13 08:21:59 +02:00

metrics.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

semgrep_arm.py

measure: Semgrep arm on the valid pilot, our rules and facts converted

2026-10-13 13:10:19 +02:00

verify.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00