Marius CiepluchandClaude Opus 5.5 2b65680d5d data: hunt training-set candidates (task 4.1), not frozen: 99 verified locations in 28 changes, awaiting spot-check ...

Sourced apart from the 12 pilot repositories: 212 candidates (pool-fresh, pool-retry, OSV for PyPI,
npm, Maven and Packagist), 49 dropped because the benchmarks already name their repository, 413
catalog locations, 99 passing all three verifier checks in 28 repositories. Short of the 40-positive
target. catalog.py now reads .java and .php. Freeze waits on the maintainer's spot-check
(CANDIDATES.md, SOURCING.md).

Co-Authored-By: Claude Opus 5.5 <[email protected]>

2026-10-13 16:48:41 +02:00

..

pilot

feat(benchmark): freeze the valid-benchmark pilot, 12 verified positives + 240 negatives

2026-10-12 19:42:45 +02:00

train

data: hunt training-set candidates (task 4.1), not frozen: 99 verified locations in 28 changes, awaiting spot-check

2026-10-13 16:48:41 +02:00

__init__.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

assemble.py

feat(benchmark): freeze the valid-benchmark pilot, 12 verified positives + 240 negatives

2026-10-12 19:42:45 +02:00

catalog.py

data: hunt training-set candidates (task 4.1), not frozen: 99 verified locations in 28 changes, awaiting spot-check

2026-10-13 16:48:41 +02:00

hunter_arm.py

feat(benchmark): combine --keep-verdicts drops hunter suspicions the classifier rejected

2026-10-13 08:21:59 +02:00

metrics.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00

semgrep_arm.py

measure: Semgrep arm on the valid pilot, our rules and facts converted

2026-10-13 13:10:19 +02:00

verify.py

feat(benchmark): valid detection benchmark spec + offline modules (groups 1-4)

2026-10-12 18:55:42 +02:00