fix(corpus): advisory-pair repo-overlap -- remove real pilot leaks, skip vendored trees

test_no_pair_repeats_a_repository_the_benchmarks_already_name failed: advisory-fix
catalog repos also appeared elsewhere under benchmarks/. Root cause split two ways:

1. Genuine leak: 16 catalog repos are also subjects in benchmarks/search/private/
   pilot.json (a real private pilot population). Removed those 16 pairs from the
   three catalogs and their verification.json rows (totals recomputed, catalog ==
   verification preserved).
2. Spurious: the overlap scan greped ~49k vendored files under
   benchmarks/search/private/runs/*/checkout/node_modules/, so any catalog repo a
   vendored dependency's README names collided. Added a narrow vendored-tree skip
   (node_modules/vendor) to the scan rather than deleting labelled pairs over a
   dependency mention.

Implemented from Codex's first pass (gpt-6.1-sol), then gated and corrected: Codex
removed 20 pairs; 4 of those (backstage/backstage, koajs/koa, beaugunderson/
ip-address, cakephp/cakephp) were driven only by vendored/non-population mentions
and are kept. Also excluded advisory-fixes-spread.json (catalog-derived report)
and research-2026-09-26.md (selection write-up) as non-population.

tests/test_advisory_fix_pairs.py + tests/test_learn_labels.py: 53 passed.

Co-Authored-By: Claude Opus 4.8 <[email protected]>
This commit is contained in:
Marius Ciepluch
2026-10-12 15:22:55 +02:00
co-authored by Claude Opus 4.8
parent 60ffff0168
commit 9a3250f6c5
8 changed files with 23 additions and 646 deletions
@@ -20,11 +20,6 @@
"ok": true,
"bytes_read": 2273
},
{
"name": "google-login-plugin-docommencelogin-532d714",
"ok": true,
"bytes_read": 2790
},
{
"name": "truelayer-dotnet-getpayment-75e436e",
"ok": true,
@@ -70,11 +65,6 @@
"ok": true,
"bytes_read": 1867
},
{
"name": "authentication-getloginredirect-1c1e29c",
"ok": true,
"bytes_read": 3975
},
{
"name": "og-image-resolve-243cac2",
"ok": true,
@@ -265,21 +255,11 @@
"ok": true,
"bytes_read": 1368
},
{
"name": "omnifaces-getupdatescript-c43eef0",
"ok": true,
"bytes_read": 1491
},
{
"name": "tablib-export-book-b0ff39f",
"ok": true,
"bytes_read": 1683
},
{
"name": "hono-resolvechildearly-2b8ed40",
"ok": true,
"bytes_read": 3041
},
{
"name": "serialize-to-js-deserialize-1cd4339",
"ok": true,
@@ -486,6 +466,6 @@
"bytes_read": 2462
}
],
"verified": 97,
"bytes_read": 367053
"verified": 93,
"bytes_read": 355756
}