mirror of
https://github.com/norandom/OpenUltraSAST.git
synced 2026-10-18 12:39:28 +00:00
Marius CiepluchandClaude Opus 4.8
8de0c2732b
Feed the milestone back into the spec and steering. HANDOFF: the open "first demonstrated" question is RESOLVED -- xiaomusic (path, prefix-check-bypass) demonstrated on the vulnerable side (3/3 affected, 0/3 safe) and the blind fixed-side search produced 0 false proofs; pair total $1.22. Records the six-fix chain that enabled it (parity, verify-time-only, fair-share budget, served-root guidance, oracle prefix-bypass coverage, control-signal feedback) plus the keystone. tasks.md: implementation note; pilot (6.2/6.3) in progress. spec.json: pilot status. safety-net steering: proof-based BLOCK mechanism reached first execution-backed demonstration (feasibility-pilot scope, not release readiness; pilot exit + 73-negative qualification open; classifier stays triage). search README: status note. Payload-free; demos/boards stay gitignored. Co-Authored-By: Claude Opus 4.8 <[email protected]>
46 lines
2.1 KiB
JSON
46 lines
2.1 KiB
JSON
{
|
|
"record": "2026-10-07 FIRST CLUSTER DEMONSTRATION for search-with-proof",
|
|
"pair": {
|
|
"index": 13,
|
|
"repo": "hanxi/xiaomusic",
|
|
"family": "path",
|
|
"class": "prefix-check-bypass (startswith without separator)",
|
|
"language": "python"
|
|
},
|
|
"image": "ghcr.io/norandom/ousast-search-task@sha256:e2c8b460...",
|
|
"side": "vulnerable",
|
|
"outcome": "demonstrated",
|
|
"verify_tasks": 18,
|
|
"model_calls": 55,
|
|
"settled_usd": 0.3686,
|
|
"wall_seconds": 2170,
|
|
"false_proofs_fixed_side": 0,
|
|
"demo_wires_served_root": true,
|
|
"finding": "The agent autonomously produced a demonstrated finding on a real CVE fix-pair end to end on the kube-ax cluster: it found the prefix-bypass sink, wired the app's served directory to ${served_root} (prompted by the new served-root control-signal hint after an earlier mis-wire), targeted the oracle's prefix-sibling canary, and the differential verifier confirmed the owned effect on the vulnerable revision and its absence on the fixed revision. Cost $0.37, 55 model calls.",
|
|
"fix_chain_that_enabled_it": [
|
|
"parity: agent targets the observable",
|
|
"verify-time-only: no explore reachability trap",
|
|
"fair-share budget: authors+verifies within budget",
|
|
"served-root guidance: wire the served dir to ${served_root}",
|
|
"oracle prefix-bypass coverage: sibling canary for startswith-without-separator vulns",
|
|
"control-signal feedback: served-root hint so the agent self-corrects wiring"
|
|
],
|
|
"both_sides": {
|
|
"vulnerable": {
|
|
"outcome": "demonstrated",
|
|
"settled_usd": 0.3686,
|
|
"verify_tasks": 18,
|
|
"model_calls": 55
|
|
},
|
|
"fixed_blind_negative": {
|
|
"outcome": "inconclusive",
|
|
"false_proof": false,
|
|
"settled_usd": 0.5632,
|
|
"verify_tasks": 18,
|
|
"model_calls": 85,
|
|
"note": "Agent searched the FIXED (safe) revision blind (no vuln knowledge); authored demos but the verifier found no effect -> no false proof (Req 6.3 negative)."
|
|
},
|
|
"pair_total_settled_usd": 1.224,
|
|
"verdict": "True positive on the vulnerable revision, zero false proof on the fixed revision."
|
|
}
|
|
} |