mirror of
https://github.com/norandom/OpenUltraSAST.git
synced 2026-10-16 03:49:26 +00:00
bench(learn): exp-001 and exp-002 registered in the memory store, units pending (decision-engine task 7.2)
Registration rows at pinfbc3220in s3://sast-memory; in-repo records under benchmarks/experiments/<id>/registration.json. exp-002's units could not be frozen: every example row in the store carries null plane-only instruments and learn.examples.load_examples raises on them (unchanged code sincea90e570) -- a store-side change to diagnose before any paid run. Co-Authored-By: Claude Fable 5.1 <[email protected]> Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo
This commit is contained in:
co-authored by
Claude Fable 5.1
parent
fbc3220bbe
commit
3b91a52788
@@ -0,0 +1,11 @@
|
||||
{
|
||||
"experiment": "exp-001-known-callers",
|
||||
"registered": "2026-10-02",
|
||||
"store": "s3://sast-memory",
|
||||
"manifest": "plane/experiments/exp-001-known-callers.yaml",
|
||||
"manifest_digest": "76b54aa5ae908a4cd7797f3b4654acf03b90e5ad5d068216036e722104313929",
|
||||
"pin": "fbc3220bbe1c8a4f8afa0a724fd41a51b390dd22",
|
||||
"units_status": "pending",
|
||||
"units_note": "model-free candidate generation on the 41 development repositories is not built; the plane's experiment-outcome task and Run annotation checks are not written",
|
||||
"status": "registered, not run"
|
||||
}
|
||||
@@ -0,0 +1,11 @@
|
||||
{
|
||||
"experiment": "exp-002-retrieval-ensemble",
|
||||
"registered": "2026-10-02",
|
||||
"store": "s3://sast-memory",
|
||||
"manifest": "plane/experiments/exp-002-retrieval-ensemble.yaml",
|
||||
"manifest_digest": "f5004fb8618b1f7cc7dcf298d42b4ac1b6c0c1aa72a97299c77f937bd6175148",
|
||||
"pin": "fbc3220bbe1c8a4f8afa0a724fd41a51b390dd22",
|
||||
"units_status": "pending",
|
||||
"units_note": "`ousast learn experiment units` could not freeze the slice-2 candidates on 2026-10-02: all 904 example rows in the store carry null for the plane-only instruments (agree, model_sinks, verify) and learn.examples.load_examples (unchanged since a90e570) raises on them; freeze, commit and register again once the rows read",
|
||||
"status": "registered, not run"
|
||||
}
|
||||
Reference in New Issue
Block a user