fix(corpus): advisory-pair repo-overlap -- remove real pilot leaks, skip vendored trees

test_no_pair_repeats_a_repository_the_benchmarks_already_name failed: advisory-fix
catalog repos also appeared elsewhere under benchmarks/. Root cause split two ways:

1. Genuine leak: 16 catalog repos are also subjects in benchmarks/search/private/
   pilot.json (a real private pilot population). Removed those 16 pairs from the
   three catalogs and their verification.json rows (totals recomputed, catalog ==
   verification preserved).
2. Spurious: the overlap scan greped ~49k vendored files under
   benchmarks/search/private/runs/*/checkout/node_modules/, so any catalog repo a
   vendored dependency's README names collided. Added a narrow vendored-tree skip
   (node_modules/vendor) to the scan rather than deleting labelled pairs over a
   dependency mention.

Implemented from Codex's first pass (gpt-6.1-sol), then gated and corrected: Codex
removed 20 pairs; 4 of those (backstage/backstage, koajs/koa, beaugunderson/
ip-address, cakephp/cakephp) were driven only by vendored/non-population mentions
and are kept. Also excluded advisory-fixes-spread.json (catalog-derived report)
and research-2026-09-26.md (selection write-up) as non-population.

tests/test_advisory_fix_pairs.py + tests/test_learn_labels.py: 53 passed.

Co-Authored-By: Claude Opus 4.8 <[email protected]>
This commit is contained in:
Marius Ciepluch
2026-10-12 15:22:55 +02:00
co-authored by Claude Opus 4.8
parent 60ffff0168
commit 9a3250f6c5
8 changed files with 23 additions and 646 deletions
@@ -185,11 +185,6 @@
"ok": true,
"bytes_read": 1699
},
{
"name": "contao-tablelookupwizard-preparewhere-a5e723a",
"ok": true,
"bytes_read": 3698
},
{
"name": "spring-module-core-getschema-d374a5f",
"ok": true,
@@ -485,11 +480,6 @@
"ok": true,
"bytes_read": 77807
},
{
"name": "email-ext-plugin-rendertemplate-7b2bd25",
"ok": true,
"bytes_read": 3416
},
{
"name": "archiva-checkparamchars-d62e81c",
"ok": true,
@@ -705,11 +695,6 @@
"ok": true,
"bytes_read": 2205
},
{
"name": "graby-cleanupxss-0295d82",
"ok": true,
"bytes_read": 1678
},
{
"name": "unhead-getstreamkey-64b5ac0",
"ok": true,
@@ -745,11 +730,6 @@
"ok": true,
"bytes_read": 3716
},
{
"name": "marimo-inject-service-worker-fdd55c8",
"ok": true,
"bytes_read": 5331
},
{
"name": "jupyterlab-git-diffheader-c6d37b8",
"ok": true,
@@ -770,11 +750,6 @@
"ok": true,
"bytes_read": 2858
},
{
"name": "twig-validatename-3d19a2e",
"ok": true,
"bytes_read": 1956
},
{
"name": "bazingajstranslationbundle-getlocales-7accee9",
"ok": true,
@@ -870,11 +845,6 @@
"ok": true,
"bytes_read": 2927
},
{
"name": "simile-butterfly-getresource-537f64b",
"ok": true,
"bytes_read": 3893
},
{
"name": "oak-send-4b2f27e",
"ok": true,
@@ -1120,11 +1090,6 @@
"ok": true,
"bytes_read": 3554
},
{
"name": "xiaomusic-music-file-88404da",
"ok": true,
"bytes_read": 5275
},
{
"name": "serializer-decode-0943a06",
"ok": true,
@@ -1175,11 +1140,6 @@
"ok": true,
"bytes_read": 3652
},
{
"name": "request-redirect-c5bcf21",
"ok": true,
"bytes_read": 5438
},
{
"name": "drill-xmlreader-0e88b7a",
"ok": true,
@@ -1256,6 +1216,6 @@
"bytes_read": 4668
}
],
"verified": 251,
"bytes_read": 1297516
"verified": 243,
"bytes_read": 1266831
}