Marius CiepluchandClaude Fable 5.1 bbbb0f397e bench(valid): a training freeze may lower the ordinary floor to the ratio; the draw takes a size ...

The held-out benchmark keeps the 40-commit floor and the union of twelve-commit stratified draws.
A training freeze passes floor=20 (never below the ratio) and the record carries ordinary_floor.
When the union of twelve-commit draws cannot reach the count (small cells stay unallocated on
every draw), one stratified draw of the full count is used; with count equal to the eligible
commits that is every one of them.

Co-Authored-By: Claude Fable 5.1 <[email protected]>

2026-10-13 18:33:10 +02:00

..

pilot

feat(benchmark): freeze the valid-benchmark pilot, 12 verified positives + 240 negatives

2026-10-12 19:42:45 +02:00

train

data: maintainer spot-check, 51 access control locations accepted (7 changes)

2026-10-13 18:09:10 +02:00

__init__.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

assemble.py

bench(valid): a training freeze may lower the ordinary floor to the ratio; the draw takes a size

2026-10-13 18:33:10 +02:00

catalog.py

data: hunt training-set candidates (task 4.1), not frozen: 99 verified locations in 28 changes, awaiting spot-check

2026-10-13 16:48:41 +02:00

hunter_arm.py

feat(benchmark): combine --keep-verdicts drops hunter suspicions the classifier rejected

2026-10-13 08:21:59 +02:00

metrics.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

semgrep_arm.py

measure: Semgrep arm on the valid pilot, our rules and facts converted

2026-10-13 13:10:19 +02:00

verify.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00