mirror of
https://github.com/norandom/OpenUltraSAST.git
synced 2026-10-16 03:49:26 +00:00
Marius CiepluchandClaude Fable 5.1
0cbdc5d2ac
Requirements 5.3, 2.1, 2.2, 2.3, 7.2 of ai-service-plane. - plane/tasks/verify.py: the batched hunt of verify_batched.py moved into the package (system prompt, one hunt per file, up to 6 candidates, 6 steps, candidate-anchored sites). New against the reference: each candidate's known callers from facts.json in the prompt (capped at 8), tool turns and usage per hunt in units.jsonl, per-unit resume (rows with "error" are re-asked), pass label from env, MeteredClient wrapper: BudgetExhausted -> unfinished (exit 3), AccountError -> failed with the provider message (exit 2); summary.json is written last, names the bound Model and the summed usage, and is done only when every unit finished. - plane/tasks/agree.py: verify_batched.agreement over two pass outputs, agreed.json / disputed.json, per-candidate cost and turns, declared-site match via benchmarks/independent/evaluate.matches_v2 loaded by file; metrics block in summary.json; no model calls. - tests/test_plane_verify.py: a scripted usage-recording hunter client; callers line, resume, 402, budget stop and resume, model and summed usage, unpriced usd None, both main() env contracts, agreement metrics. - model/audit.py + module-audit manifest: SPEC_OWNED rows for plane.tasks, plane.tasks.verify, plane.tasks.agree; manifest regenerated. Co-Authored-By: Claude Fable 5.1 <[email protected]> Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo