bench(learn): injection first slice -- compiled AI classifier, out-of-repo evaluation (decision-engine 6.2, 6.6)

6.2: the 724 static examples' 616 distinct excerpts embedded with openai/text-embedding-3-small via
OpenRouter, 198,819 tokens, $0.0040 metered (ceiling $1).

6.6, family injection only, memory = every family (at most 2 contrast examples per prompt), input
profile v1: smoke fixed k = 5 (repeat prefix-cache hit share 0.96); one compile (program c1237a49,
proposed instruction 5, balanced Brier 0.128 on 13 C_val candidates vs 0.199 baseline); outer grouped
5-fold, 110 out-of-repository candidates in 29 groups: ADVISORY recall 0.90 [0.82, 0.97], precision
0.54 [0.44, 0.65], AUC 0.74; BLOCK not offered (ECE 0.064 > 0.05; no fold reached a Wilson lower bound
of 0.95); canary re-ask agreement 0.83. $0.91 metered at list price; DeepSeek balance $18.20 -> $17.90.

Instrument fixes found on the way, each with a test:
- memory build: pair sides join the record stored under their harvest unit pin (--units), and only the
  built profile's records are read (static and plane shared a key; 85 -> 724 examples);
- retrieval: stage 1 per side (family / contrast) and at most 2 contrast examples, never padded;
- program: the JSON answer contract is part of the signature, appended to proposed instructions
  (DeepSeek JSON mode refused a prompt without "json");
- compile: candidate_families for a one-family compile; compile.toml k = 5 from the smoke rule.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo

src/openultrasast/learn/cli.py

@@ -25,6 +25,7 @@ def add_commands(learn_sub: Any) -> None:
     build.add_argument("--cache", type=Path, help="clones and checkouts (default ~/.cache/openultrasast)")
     build.add_argument("--memory", help="the store (default OUSAST_MEMORY, then results_root()/memory)")
     build.add_argument("--profile", choices=("static", "plane"), default="static")
+    build.add_argument("--units", type=Path, help="the harvest units.json: the pin each pair side's record is stored under")
     build.add_argument("--dry-run", action="store_true", help="count, write nothing")
     embed = memory_sub.add_parser("embed", help="embed the stored excerpts (OpenRouter, metered; cached by excerpt sha)")
     embed.add_argument("--memory", help="the store (default OUSAST_MEMORY, then results_root()/memory)")
@@ -209,19 +210,21 @@ def _memory_embed(args: argparse.Namespace) -> int:
 def _memory_build(args: argparse.Namespace) -> int:
     """Exit 2 on a refused label (``origin: user``, a source outside the list) or a source with >10% unread excerpts."""
     from ..plane.memory import open_store
-    from .examples import ExampleBuildError, SideReader, build_examples, read_jsonl, records_by_key
+    from .examples import ExampleBuildError, SideReader, build_examples, pair_pins, read_jsonl, records_by_key
     from .labels import DEFAULT_CACHE, DEFAULT_SOURCES, load_sources
 
     sources = load_sources(args.sources or DEFAULT_SOURCES)
     labels = read_jsonl(args.labels)
     store = None if args.dry_run else open_store(args.memory)
-    rows = [row for path in args.features for row in read_jsonl(path)]
+    rows = [row for path in args.features for row in read_jsonl(path) if row.get("profile", args.profile) == args.profile]
     if store is not None:
-        rows += [r.row for r in store.rows(kind="features")]
+        # one profile only: the static and plane records of a candidate share a key, and the other would overwrite it
+        rows += [r.row for r in store.rows(kind="features") if r.row.get("profile") == args.profile]
     reader = SideReader(args.root, args.cache or DEFAULT_CACHE, sources, labels)
     try:
         build = build_examples(
             labels, records_by_key(rows), reader, sources=sources, store=store, profile=args.profile, license_of=reader.license,
+            pins=pair_pins(json.loads(args.units.read_text(encoding="utf-8"))) if args.units is not None else None,
         )  # fmt: skip
     except ExampleBuildError as exc:
         print(f"learn memory build: {exc}", file=sys.stderr)