mirror of
https://github.com/norandom/OpenUltraSAST.git
synced 2026-10-16 19:59:26 +00:00
Marius CiepluchandClaude Fable 5.1
ec7a5ed90d
Exploratory, 7 of 17 cases, stopped when the account emptied: - source-only scope: a model reading every product file puts the vulnerable function among the candidates in 15/17 (ranker 1/17, vocabulary 2/17); - per-file triage + per-file 6-step hunts + two-pass agreement: 12/15 candidate cases on the validation set; 4/7 on the full run, two more in one pass of two; - precision: 5 pgAdmin agreed findings read against source, 3 true (privileged), 2 false with self-contradicting rationales; agreement cannot catch an error both passes make; - cost: $0.009-0.022 per candidate for two passes. Four instrument defects fixed on the way (model id, provider routing, JSON-mode final turn, unbounded tool output) void the earlier hunter number. No gate is met; qualification needs population v3 and a protocol that states the judge stage, the pass rule and a config-family question. Co-Authored-By: Claude Fable 5.1 <[email protected]> Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo