diff --git a/.kiro/specs/contributor-scan/pre-push-runtime-followup.md b/.kiro/specs/contributor-scan/pre-push-runtime-followup.md index 0fe74f9..f6f54eb 100644 --- a/.kiro/specs/contributor-scan/pre-push-runtime-followup.md +++ b/.kiro/specs/contributor-scan/pre-push-runtime-followup.md @@ -41,3 +41,26 @@ and its compressed full evidence bundle. All 21 deadline-bound transactions time Every measured artifact matches the frozen installed semantics. No source, engine, query, fact or ranking change was made during this run. The follow-up remains necessary before rollout; the evaluation task does not authorize weakening its gates. + +## VAmPI qualification follow-up, 2026-09-13 + +Task 8.3's packaged frozen regression (139,164 total snapshot bytes read per replay) +retains raw findings at `models/user_model.py:73:get_user`, +`api_views/users.py:187:update_password`, and `api_views/books.py:51:get_by_title`. +The SQLI target has no selected exact function question; the two authorization target +questions are selected at positions 93 and 63 but have `change_context_incomplete`. +Head scope retains 138 selected and 20 deferred questions. Raw findings do not prove +completed target questions or a transitive source-to-target witness. + +The first lab run took 112.415s; same-snapshot cached replays took 6.816s and 6.684s, +all incomplete. This is diagnostic reuse, not changed-code performance qualification. +The 600-second budget is distinct from the hook acceptance profile. Full artifacts are +in `2026-09-13-push-qualification.json.gz` under the regression population. + +Reconcile evidence normalization and the unsupported context projection at the shared +scan boundary before downstream admission: retain the actual query-origin/path witness +when available, resolve supported first-party context, and keep unresolved dynamic/vendor +boundaries explicit. Do not fabricate transitivity from a raw finding at the target. +Revalidate ordinary VAmPI scan, exact question accounting, push regressions and independent +qualification after an approved owner fix. This note records the prerequisite; it does +not silently approve an upstream implementation or change detector semantics. diff --git a/.kiro/specs/pre-push-safety-net/implementation-group-8.md b/.kiro/specs/pre-push-safety-net/implementation-group-8.md index c3da06b..6e2a7d7 100644 --- a/.kiro/specs/pre-push-safety-net/implementation-group-8.md +++ b/.kiro/specs/pre-push-safety-net/implementation-group-8.md @@ -106,3 +106,98 @@ retune the ranker or weaken the population/gates to compensate. - CLAIM: Task 8.2 completed its prescribed measurement and owner routing; rollout remains NO-GO. - EVIDENCE: Versioned scorecard and 116-file verified bundle; seven scorer controls and full regression suite pass. - GAPS: No qualified warm graph path or independent capability eligibility established. These failed gates cannot authorize rollout. + +## Task 8.3 brief + +Requirements 3.1, 3.2, 6.1–6.5 and 8.1–8.4; evaluation and actionability integration. +Implement a trusted installed eligibility resource whose evidence is recomputed against +exact core/engine/runtime/facts/query/policy/semantic identities. Require reviewed +operation/advice scope, vulnerable/fixed/benign populations, nonzero actual positive +controls and reviewed alerts, untouched per-capability evaluation and all joint gates. +The normal runner consumes only eligible declarations; stale or inconsistent resources +admit nothing. This is integrity checking of trusted release evidence, not signing or +permission to load repository-authored eligibility. + +Freeze the current packaged candidate before the six PMPro/Node development replays. +Run readable VAmPI regression snapshots under a separate 600-second laboratory profile; +keep their missing independent pairs unresolved. Execute libpng as an unsupported +30-second envelope control. Do not inspect or tune on Ghost before its reviewed +population exists. Missing required evidence leaves task 8.3 qualification blocked, +even when the reproducible NO-GO artifact and admission implementation are delivered. + +### Review scope + +Synthetic controls prove that a matching reviewed population can reach the real runner +admission seam, while stale facts/runtime, missing positive observations, absent reviews, +wrong untouched workloads and changed consequence/repair semantics cannot. They are +contract controls, not real capability qualification. The installed NO-GO resource must +recompute identically and enable zero capabilities. The source has no repository- or +language-specific rank changes, frontend adaptations or new abstract domains. + +### Task 8.3 measured outcome + +Packaged candidate `9464e229ccfdc873a02e3a0db7c1e83a6d6ec6d3e8234ae7b97677b4aed836fd` +executed offline as UID 1000 with a 3 GiB memory limit. Each profile was written before +its runs. All six development pushes saved artifacts, timed out in 30.559–30.678s and +retained all 11 declared cases. Source snapshot receipts read 57.9–58.1 MB per PMPro +comparison and 5.95 MB per Node comparison. These are snapshot bytes, not graph census. +The supported introducing-change recall is 0/2, Wilson 95% interval [0, 0.658]; actual +reviewed alert precision is undefined (0/0), never 100%. Neither fixed case has a +completed witnessed negative. The two benign pushes emitted no alerts; that silence +with incomplete coverage does not establish a useful safety net. + +VAmPI's 600-second laboratory profile executed all three pinned regression targets, +reading 139,164 snapshot bytes per replay. First run 112.415s; subsequent identical +comparisons 6.816s and 6.684s, each with two graph hits and 403 query hits. Raw findings +retain the known SQLI and two authorization sites, but the SQLI exact function question +is unlocated and authorization questions are `change_context_incomplete`. All three +remain unresolved; no transitive witness or completed regression detection is credited. +There are 138 selected and 20 deferred head questions. Context/witness normalization +is routed to the shared scan owner. A registry-generation provenance probe overlapped +startup of the first lab run; these timings are diagnostic, not runtime-gate samples. + +The initial instrument labeled all regression replays cold. The two proved identical +cache replays were relabeled `identical_tip` and rescored without changing measurements, +profile or population; original run/scorecard/instrument and correction are retained. +Future instrument output distinguishes these identical comparisons. None is a warm edit. + +The libpng unsupported envelope saved a partial artifact after 30.590s. Ghost's checkout +and reviewed independent cases remain missing and were not scanned. Independent PHP +and Python admission populations also remain missing. No ranker, fact, adapter or query +retune occurred. The 59-file compressed evidence bundle is verified against originals: +`benchmarks/measurements/2026-09-13-push-qualification.json.gz`, SHA-256 +`79226b4e54042559ba5cc2b94b69b1dcddb550872fd0783b2380368be72f90bd`. + +The installed eligibility resource is reproducible NO-GO, digest +`2ddd94d4dc3fd6b84e7de38e5f211d2653fb993c64e4e43cedf7e06062c3265c`, with zero enabled +capabilities. Task 8.2 runtime evidence remains failed and predates the eligibility +policy addition; it is correctly rejected as admission evidence, not relabeled current. + +## Status Report +- STATUS: BLOCKED +- TASK: 8.3 +- RED_PHASE_OUTPUT: `/tmp/group8-3-red.log`: eight failures with eligibility disabled; ON passed, switch removed; final synthetic and installed-resource contracts verified separately. +- IMPLEMENTED: Versioned eligibility generation/loading, production admission integration, real offline replay and NO-GO artifact. +- BLOCKER: Required independent Node/PHP/Python reviewed populations and verified VAmPI transitive question witness are absent. Runtime/completion gates fail. + +## Review Verdict +- VERDICT: REJECTED +- TASK: 8.3 completion claim +- MECHANICAL_RESULTS: Eligibility and runner implementation inspected; fixed semantic/advice scope, observed controls and exact provenance required. No language-specific ranker changes, placeholders or secrets. RED phase verified. +- FINDINGS: Implementation and reproducible NO-GO decision are concrete, but task 8.3's mandatory independent transfer and transitive-regression evidence is not established. Main-context fallback does not provide independent review. +- REMEDIATION: Repair the shared context/witness and census/runtime prerequisites; obtain reviewed untouched paired populations, refreeze and rerun all joint gates. Keep capabilities disabled meanwhile. +- SUMMARY: Retain the useful implementation, leave task 8.3 unchecked and feature rollout NO-GO. + +## Verification Result +- STATUS: NOT_VERIFIED +- CLAIM_TYPE: TASK +- CLAIM: Full task 8.3 qualification complete. +- EVIDENCE: Real frozen replay and installed decision explicitly preserve failed gates and missing evidence. +- GAPS: Independent populations, completed positive/fixed controls, VAmPI transitive witness and representative runtime/coverage. +- NOTES: Proceed with authorized task 8.4's explicit NO-GO acceptance reconciliation; it does not depend on pretending qualification passed. + +Task 8.3 implementation verification: full suite **1317 passed, 9 skipped in 115.80s** +(`/tmp/group8-3-complete-suite.log`, exit 0). After the measurement-label correction, +14 focused eligibility/replay-instrument tests passed in 0.95s. Ruff, format, mypy +(116 source files) and diff checks pass. These verify the delivered code and recorded +NO-GO behavior, not the rejected full qualification claim above. diff --git a/.kiro/specs/pre-push-safety-net/spec.json b/.kiro/specs/pre-push-safety-net/spec.json index 0586e7a..687dee2 100644 --- a/.kiro/specs/pre-push-safety-net/spec.json +++ b/.kiro/specs/pre-push-safety-net/spec.json @@ -132,7 +132,10 @@ "implementation-group-8.md" ], "next_group": 8, - "blocked_tasks": [], - "feasibility": "NO-GO: all 21 frozen NodeGoat transactions timed out; 0/24 declared target checks completed. Cancellation/reporting remained below 2 seconds. Priming did not qualify graph reuse; named census and engine lifecycle work routed to contributor-scan." + "blocked_tasks": [ + "8.3" + ], + "feasibility": "NO-GO: all 21 frozen NodeGoat transactions timed out; 0/24 declared target checks completed. Cancellation/reporting remained below 2 seconds. Priming did not qualify graph reuse; named census and engine lifecycle work routed to contributor-scan.", + "qualification": "NO-GO: eligibility implementation and evidence delivered; required independent populations and verified VAmPI transitive witness remain missing. Zero capabilities enabled." } } diff --git a/.kiro/specs/pre-push-safety-net/tasks.md b/.kiro/specs/pre-push-safety-net/tasks.md index d14a02f..d0d3e82 100644 --- a/.kiro/specs/pre-push-safety-net/tasks.md +++ b/.kiro/specs/pre-push-safety-net/tasks.md @@ -234,6 +234,7 @@ independent capability qualification. Groups 7–8 remain pending; rollout remai - _Boundary: Evaluation harness, Delta and Actionability Policy integration_ - _Depends: 1.2, 1.3, 5.2, 7.3, 8.2_ - _Requirements: 3.1, 3.2, 6.1, 6.2, 6.3, 6.4, 6.5, 8.1, 8.2, 8.3, 8.4_ + - _Blocked 2026-09-13:_ Eligibility implementation and reproducible NO-GO artifact delivered; independent reviewed Node/PHP/Python populations and verified VAmPI transitive witness remain missing. Runtime/coverage gates fail. See `implementation-group-8.md` and contributor-scan owner follow-up. - [ ] 8.4 Verify the packaged end-to-end outcome and acceptance coverage - Run the required regression checks and a local packaged smoke over supported security/fixed/benign pushes; verify no-model startup, preservation of hook behavior and truthful partial results. - Reconcile every acceptance criterion with fresh evidence and record unresolved capability/performance blockers separately from completed plumbing. diff --git a/benchmarks/measurements/2026-09-08-module-audit.json b/benchmarks/measurements/2026-09-08-module-audit.json index 99e0b47..21fcef5 100644 --- a/benchmarks/measurements/2026-09-08-module-audit.json +++ b/benchmarks/measurements/2026-09-08-module-audit.json @@ -1,10 +1,10 @@ { "counts": { - "load_bearing": 105, + "load_bearing": 106, "standalone_capability": 9 }, - "modules": 114, - "note": "Refreshed for group 7: push runner reaches optional bounded witness selection; registry remains empty.", + "modules": 115, + "note": "Group 8: runner reaches recomputed versioned eligibility and its frozen scorer.", "orphaned": [], "rows": [ { @@ -140,6 +140,7 @@ "model.scan", "model.taint", "push.cache", + "push.eligibility", "push.policy", "push.reuse", "push.runner" @@ -152,6 +153,7 @@ "importers": [ "cpg.backend", "push.cache", + "push.eligibility", "push.policy", "push.reuse", "push.runner" @@ -704,6 +706,7 @@ "importers": [ "cli", "push.assistance", + "push.eligibility", "push.policy", "push.report", "push.reuse", @@ -746,6 +749,15 @@ { "classification": "load_bearing", "importers": [ + "push.runner" + ], + "module": "push.eligibility", + "reason": "reachable from gate, map_gate, pair_gate or the CLI" + }, + { + "classification": "load_bearing", + "importers": [ + "push.eligibility", "push.report", "push.runner" ], @@ -794,7 +806,9 @@ }, { "classification": "standalone_capability", - "importers": [], + "importers": [ + "push.eligibility" + ], "module": "push_scoring", "reason": "pre-push-safety-net task 1.3: frozen-profile diagnostic outcome scorer; python -m openultrasast.push_scoring" }, diff --git a/benchmarks/measurements/2026-09-13-push-qualification.json b/benchmarks/measurements/2026-09-13-push-qualification.json new file mode 100644 index 0000000..1d4a2ca --- /dev/null +++ b/benchmarks/measurements/2026-09-13-push-qualification.json @@ -0,0 +1,3388 @@ +{ + "schema_version": 1, + "verdict": "NO-GO", + "feature_complete": false, + "capabilities_enabled": 0, + "image": "sha256:9464e229ccfdc873a02e3a0db7c1e83a6d6ec6d3e8234ae7b97677b4aed836fd", + "bundle": { + "path": "2026-09-13-push-qualification.json.gz", + "sha256": "79226b4e54042559ba5cc2b94b69b1dcddb550872fd0783b2380368be72f90bd", + "size": 1208658, + "files": 59 + }, + "populations": { + "qualification-development-v1": { + "decision": { + "decision": "NO-GO", + "capabilities_enabled": false, + "scorecard": "scorecard.json", + "reason": "Qualification evidence run; independent eligibility and joint quality/warm-latency gates remain unmet.", + "selection": "development", + "analysis_deadline_seconds": 30, + "recorded_cases": 6, + "declared_population": 11, + "core_unchanged": true, + "adapter_changes": [], + "limits": [ + "No warm-cache measurements", + "Untouched Ghost population not scanned", + "PHP/Python admission populations missing", + "libpng retained as unsupported envelope; no C/C++ detection claim", + "Zero normal alerts from an empty registry cannot establish precision or useful recall" + ] + }, + "metrics": { + "schema_version": 1, + "profile_sha256": "5afd697cdd378917d08d84f51f3657e71013ec90ffb17804ab661e9df951bea2", + "population": 11, + "recorded_cases": 6, + "measurement_status": "recorded", + "metrics": { + "recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ], + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 9, + "value": 0.0, + "wilson95": [ + 0.0, + 0.2991450484195441 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 1308, + "value": null, + "wilson95": null, + "unmeasured_cases": 3 + }, + "latency": { + "cold": { + "samples": 6, + "p50": 30.606516609084792, + "p95": 30.678011666052043 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 11, + "timeouts": 6 + }, + "by_capability": { + "c/libpng/memory_safety": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "javascript/express/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ], + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 1308, + "value": 0.0, + "wilson95": [ + 0.0, + 0.002928295027470378 + ], + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 3, + "p50": 30.56611180899199, + "p95": 30.606516609084792 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 3 + }, + "javascript/express/unreviewed": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "php/wordpress/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ], + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 3, + "p50": 30.645914101973176, + "p95": 30.678011666052043 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 3 + }, + "python/flask/access_control": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 2 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 2, + "timeouts": 0 + }, + "python/flask/injection": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 1 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + } + }, + "admission": "experimental", + "gates_passed": false, + "note": "Diagnostic instrument only. No admission without independent capability evaluation. Missing runs contribute only conservative full-population bounds, not observed detector performance. Witness association is checked; semantic/actionability review is supplied evidence, not inferred from rank." + }, + "cases": [ + { + "id": "pmpro-introduce", + "base": "pmpro-fixed", + "tip": "pmpro-vulnerable", + "label": "vulnerable", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-repair", + "base": "pmpro-vulnerable", + "tip": "pmpro-fixed", + "label": "fixed", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "PMPro upstream2.9.7 to2.9.8 parameter binding fix for CVE-2023-23488.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-benign", + "base": "pmpro-vulnerable", + "tip": "pmpro-benign", + "label": "benign", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-introduce", + "base": "nodegoat-fixed", + "tip": "nodegoat-vulnerable", + "label": "vulnerable", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-repair", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-fixed", + "label": "fixed", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replacement of three eval calls with Number conversion; source tutorial also documents alternate numeric parsing.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-benign", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-benign", + "label": "benign", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "ready", + "input_problem": null + }, + { + "id": "VAmPI-SQLI", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/injection", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA-BOOKS", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "libpng-CVE-2025-66293", + "base": "libpng-envelope", + "tip": "libpng-envelope", + "label": "unsupported", + "role": "envelope", + "capability": "c/libpng/memory_safety", + "provenance": "Arithmetic/bounds is outside the current abstract domain; measures graph/cost envelope only.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "ghost-reserved-population", + "base": "ghost-reserved", + "tip": "ghost-reserved", + "label": "unreviewed", + "role": "reserved_holdout", + "capability": "javascript/express/unreviewed", + "provenance": "Reserved from production API/module/async shape and public security-fix history before scanner results. Manifest6.64.0-rc.0, Express4.22.2. Not an ESM or Express5 coverage claim.", + "prerequisites": [ + "Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.", + "Freeze core and existing facts after development; preserve reservation and record any contamination." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.; Freeze core and existing facts after development; preserve reservation and record any contamination." + } + ], + "execution": { + "cases": [ + { + "case_id": "pmpro-introduce", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "2f65530f9442b4d7ccfb56821836b056217358c1", + "--head", + "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "--artifact", + "/results/qualification-development-v1/pmpro-introduce.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.678011666052043, + "artifact": "pmpro-introduce.json", + "terminal": "No analysis result is available.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/pmpro-introduce.json\n", + "core_unchanged": true, + "input_pins": { + "base": "2f65530f9442b4d7ccfb56821836b056217358c1", + "head": "1a900be3f09f243876150fc3c04a97bcb24ef84b" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "preparation_failed:TimeoutError", + "deadline_exhausted", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.02946803206577897, + "provenance_seconds": 0.4109192460309714, + "snapshot_seconds": 12.56004240596667, + "snapshot_reuses": 0, + "preparation_seconds": 29.629872135003097, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.096643798053265 + }, + "snapshot_bytes_read": 58067472, + "classification": "scope/deadline" + }, + { + "case_id": "pmpro-repair", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "--head", + "2f65530f9442b4d7ccfb56821836b056217358c1", + "--artifact", + "/results/qualification-development-v1/pmpro-repair.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.63855000003241, + "artifact": "pmpro-repair.json", + "terminal": "No analysis result is available.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/pmpro-repair.json\n", + "core_unchanged": true, + "input_pins": { + "base": "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "head": "2f65530f9442b4d7ccfb56821836b056217358c1" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "preparation_failed:TimeoutError", + "deadline_exhausted", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.021197271067649126, + "provenance_seconds": 0.34009084198623896, + "snapshot_seconds": 12.467126300907694, + "snapshot_reuses": 0, + "preparation_seconds": 29.707301164977252, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.095304238027893 + }, + "snapshot_bytes_read": 58067472, + "classification": "scope/deadline" + }, + { + "case_id": "pmpro-benign", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "--head", + "f6b615ed11733e8975bdff087d2028b5a5bac9f7", + "--artifact", + "/results/qualification-development-v1/pmpro-benign.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.645914101973176, + "artifact": "pmpro-benign.json", + "terminal": "No analysis result is available.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/pmpro-benign.json\n", + "core_unchanged": true, + "input_pins": { + "base": "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "head": "f6b615ed11733e8975bdff087d2028b5a5bac9f7" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "preparation_failed:TimeoutError", + "deadline_exhausted", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.0197974459733814, + "provenance_seconds": 0.2962435589870438, + "snapshot_seconds": 11.787582749966532, + "snapshot_reuses": 0, + "preparation_seconds": 29.754213382024318, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.09343235695269 + }, + "snapshot_bytes_read": 57924614, + "classification": "scope/deadline" + }, + { + "case_id": "nodegoat-introduce", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "0b453d5abc38f1a970d4771ebe6c5413f8c3b0a4", + "--head", + "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "--artifact", + "/results/qualification-development-v1/nodegoat-introduce.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.559429201995954, + "artifact": "nodegoat-introduce.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/nodegoat-introduce.json\n", + "core_unchanged": true, + "input_pins": { + "base": "0b453d5abc38f1a970d4771ebe6c5413f8c3b0a4", + "head": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "6170702f726f757465732f636f6e747269627574696f6e732e6a73:ambiguous_line_correspondence", + "deadline_exhausted", + "admission_failed:TimeoutError", + "change_context_deadline_exhausted", + "vendor_semantics_unresolved", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.019262752030044794, + "provenance_seconds": 0.30368757899850607, + "snapshot_seconds": 0.9765457049943507, + "snapshot_reuses": 0, + "discovery_seconds": 6.643150272080675, + "discovery_hits": 0, + "preparation_seconds": 7.640034031006508, + "head_seconds": 22.062753806007095, + "base_seconds": 0.00027251499705016613, + "admission_seconds": 0.007778907078318298, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.058397019049153 + }, + "snapshot_bytes_read": 5952014, + "classification": "scope/deadline" + }, + { + "case_id": "nodegoat-repair", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "--head", + "0b453d5abc38f1a970d4771ebe6c5413f8c3b0a4", + "--artifact", + "/results/qualification-development-v1/nodegoat-repair.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.606516609084792, + "artifact": "nodegoat-repair.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/nodegoat-repair.json\n", + "core_unchanged": true, + "input_pins": { + "base": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "head": "0b453d5abc38f1a970d4771ebe6c5413f8c3b0a4" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "6170702f726f757465732f636f6e747269627574696f6e732e6a73:ambiguous_line_correspondence", + "deadline_exhausted", + "admission_failed:TimeoutError", + "change_context_deadline_exhausted", + "vendor_semantics_unresolved", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.018091536010615528, + "provenance_seconds": 0.3024843540042639, + "snapshot_seconds": 0.959272945066914, + "snapshot_reuses": 0, + "discovery_seconds": 6.849736295989715, + "discovery_hits": 0, + "preparation_seconds": 7.827876616036519, + "head_seconds": 21.870985461049713, + "base_seconds": 0.0002911860356107354, + "admission_seconds": 0.009124082047492266, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.05339005496353 + }, + "snapshot_bytes_read": 5952014, + "classification": "scope/deadline" + }, + { + "case_id": "nodegoat-benign", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-szibj420/objects.git", + "--base", + "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "--head", + "f772c59e5964c77812a6a89737eb54ed5371d30c", + "--artifact", + "/results/qualification-development-v1/nodegoat-benign.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.56611180899199, + "artifact": "nodegoat-benign.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-development-v1/nodegoat-benign.json\n", + "core_unchanged": true, + "input_pins": { + "base": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "head": "f772c59e5964c77812a6a89737eb54ed5371d30c" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "6170702f726f757465732f636f6e747269627574696f6e732e6a73:ambiguous_line_correspondence", + "deadline_exhausted", + "admission_failed:TimeoutError", + "change_context_deadline_exhausted", + "vendor_semantics_unresolved", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.017291492084041238, + "provenance_seconds": 0.2788600909989327, + "snapshot_seconds": 0.9446105420356616, + "snapshot_reuses": 0, + "discovery_seconds": 6.772797371027991, + "discovery_hits": 0, + "preparation_seconds": 7.735924498992972, + "head_seconds": 21.987020123982802, + "base_seconds": 0.00029614497907459736, + "admission_seconds": 0.007813613046891987, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.051670238026418 + }, + "snapshot_bytes_read": 5952021, + "classification": "scope/deadline" + } + ], + "core_changes": [], + "adapter_changes": [], + "freeze_after_pmpro": { + "ranking_mode": "evidence", + "engine": "joern-4.0.625", + "engine_runtime": "2b415139532d8d3a0c6e46ecdac26cd3d792efc2bae441f0b7e39bb28ec5d16e", + "facts": "32edb6e1a78f1afb08ac4248cd436be16663e0d90dc1b3aaf948f2ce49a5a8f0", + "queries": "7bf090e053331f03d04c9290c8a593d00efd4d390f4b77b8382c2befc47996cc", + "policy": "6fc8e3cf0d3a4f45dd882e37a753e34bc0cd187295cfbd3cbb6fc36ecf9cea20", + "core": "36ac9a045b8b8ad943eea1f511924caae54750a9d5d45da776ebefc460f08eab", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + } + } + }, + "qualification-regression-v1": { + "decision": { + "decision": "NO-GO", + "capabilities_enabled": false, + "scorecard": "scorecard.json", + "reason": "Qualification evidence run; independent eligibility and joint quality/warm-latency gates remain unmet.", + "selection": "regression", + "analysis_deadline_seconds": 600.0, + "recorded_cases": 3, + "declared_population": 11, + "core_unchanged": true, + "adapter_changes": [], + "limits": [ + "No warm-cache measurements", + "Untouched Ghost population not scanned", + "PHP/Python admission populations missing", + "libpng retained as unsupported envelope; no C/C++ detection claim", + "Zero normal alerts from an empty registry cannot establish precision or useful recall" + ] + }, + "metrics": { + "schema_version": 1, + "profile_sha256": "4c58aa2a064b2f897996b3d34d8363ac1ca08b14f4cda5699e6885fdce91fbc5", + "population": 11, + "recorded_cases": 3, + "measurement_status": "recorded", + "metrics": { + "recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 2, + "value": null, + "wilson95": null, + "unobserved": 2 + }, + "completion": { + "numerator": 0, + "denominator": 9, + "value": 0.0, + "wilson95": [ + 0.0, + 0.2991450484195441 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 474, + "value": null, + "wilson95": null, + "unmeasured_cases": 6 + }, + "latency": { + "cold": { + "samples": 1, + "p50": 112.41530801192857, + "p95": 112.41530801192857 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 2, + "p50": 6.684015898965299, + "p95": 6.816393535002135 + } + }, + "unresolved": 11, + "timeouts": 0 + }, + "by_capability": { + "c/libpng/memory_safety": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "javascript/express/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": null, + "wilson95": null, + "unobserved": 1 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 3 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 0 + }, + "javascript/express/unreviewed": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "php/wordpress/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": null, + "wilson95": null, + "unobserved": 1 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 3 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 0 + }, + "python/flask/access_control": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 316, + "value": 0.0, + "wilson95": [ + 0.0, + 0.012010509315640912 + ], + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 2, + "p50": 6.684015898965299, + "p95": 6.816393535002135 + } + }, + "unresolved": 2, + "timeouts": 0 + }, + "python/flask/injection": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 158, + "value": 0.0, + "wilson95": [ + 0.0, + 0.023735937927685878 + ], + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 1, + "p50": 112.41530801192857, + "p95": 112.41530801192857 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + } + }, + "admission": "experimental", + "gates_passed": false, + "note": "Diagnostic instrument only. No admission without independent capability evaluation. Missing runs contribute only conservative full-population bounds, not observed detector performance. Witness association is checked; semantic/actionability review is supplied evidence, not inferred from rank." + }, + "cases": [ + { + "id": "pmpro-introduce", + "base": "pmpro-fixed", + "tip": "pmpro-vulnerable", + "label": "vulnerable", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-repair", + "base": "pmpro-vulnerable", + "tip": "pmpro-fixed", + "label": "fixed", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "PMPro upstream2.9.7 to2.9.8 parameter binding fix for CVE-2023-23488.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-benign", + "base": "pmpro-vulnerable", + "tip": "pmpro-benign", + "label": "benign", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-introduce", + "base": "nodegoat-fixed", + "tip": "nodegoat-vulnerable", + "label": "vulnerable", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-repair", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-fixed", + "label": "fixed", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replacement of three eval calls with Number conversion; source tutorial also documents alternate numeric parsing.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-benign", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-benign", + "label": "benign", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "VAmPI-SQLI", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/injection", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA-BOOKS", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "target unmatched, unanswered, or lacks exact witnessed answer", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "libpng-CVE-2025-66293", + "base": "libpng-envelope", + "tip": "libpng-envelope", + "label": "unsupported", + "role": "envelope", + "capability": "c/libpng/memory_safety", + "provenance": "Arithmetic/bounds is outside the current abstract domain; measures graph/cost envelope only.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "ghost-reserved-population", + "base": "ghost-reserved", + "tip": "ghost-reserved", + "label": "unreviewed", + "role": "reserved_holdout", + "capability": "javascript/express/unreviewed", + "provenance": "Reserved from production API/module/async shape and public security-fix history before scanner results. Manifest6.64.0-rc.0, Express4.22.2. Not an ESM or Express5 coverage claim.", + "prerequisites": [ + "Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.", + "Freeze core and existing facts after development; preserve reservation and record any contamination." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.; Freeze core and existing facts after development; preserve reservation and record any contamination." + } + ], + "execution": { + "cases": [ + { + "case_id": "VAmPI-SQLI", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-kyvk9pk7/objects.git", + "--base", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--head", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--artifact", + "/results/qualification-regression-v1/VAmPI-SQLI.json", + "--deadline", + "600.0", + "--cancellation-allowance", + "2", + "--max-regions", + "500", + "--cache-dir", + "/results/vampi-cache" + ], + "process_exit_code": 0, + "elapsed_seconds": 112.41530801192857, + "artifact": "VAmPI-SQLI.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Some checks are not enabled for normal alerts. Review capability coverage in the details.\nDetails: /results/qualification-regression-v1/VAmPI-SQLI.json\n", + "core_unchanged": true, + "input_pins": { + "base": "f16052dce83f05847133ec98f01c5193a41de7d8", + "head": "f16052dce83f05847133ec98f01c5193a41de7d8" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "capability_unavailable", + "comparison_unknown", + "witness_unresolved", + "dependency_unresolved", + "eligibility:eligibility_invalid_or_unavailable", + "witness_identity_unresolved", + "context_projection_unavailable:contributor-scan:b6e6786dce09d848d3bb498c168c49dda5c474537892ef6f9c7df68ebabdf550", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5fd8c7c2cb3416fe25b4c1437ea95ffba902e60407139a6b5d5c9d0a898beb17", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d3df6b543c4f932ffc44880f53a20d8e2a39b01aaed423c81c06fe8dff906acb", + "dynamic_external_or_depth_context_unresolved:contributor-scan:98d5d6114cd938cf0b0a384d35d279d5754c2aea55804b3dbb24a915753924b2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3aabf2177b0762d91115354177297f9b7fe6f3452c9c17ca2ff5a2cb03ecf98c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:68865c15daec49375f4bfb2f0acf7e48f45fd56909f137b1574b5ebf09d01095", + "context_projection_unavailable:contributor-scan:befb0ba6eeb35a1c34fbb30181339acb1c2b66c1ab373ef428b86208752dbd39", + "context_projection_unavailable:contributor-scan:7ac7cf444129e4df728e3ccf3f87cda6df1f45166d5f31acaa05c3bbf62f43ce", + "dynamic_external_or_depth_context_unresolved:contributor-scan:72b8e224c83e4e007aa6cab72f158df9b99f892db8994c65407e16ca4c929401", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b61225a697d36ca5907ae4c3100b8f155ec5a24c9039353d0688d37797cb5806", + "dynamic_external_or_depth_context_unresolved:contributor-scan:65d6f3f5eda2624c775b024e33bce4ca6cd7efa48b7a9060a2e9ecac2cb168d7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14a40f1cf8dd2eb92a31924cefc194cb364ee5e1c0f250740cdaaeaa45f7e222", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6d9cd82ed2b32c3d3d1852c65ac45a216f6e52e9a07bfab2501efbbeacd27a3e", + "context_projection_unavailable:contributor-scan:cdfa7ab2ac8e36fdd45cc472a83490c2fbd8b8ee141f08a82c0e4969c2c381c3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7856547fcb5c892066df29acbb3ef7da66b6179a92ae7aad8d8155ef3e48149b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:abd418304da4d1034dbdc261664c3cf83c35328940519ff14224fd69e5e4ee0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14536e658fd2e034c24c93c37b4cca1c8111c8e41831015e1212f2941f9b394f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7d88eb9dfc8a80dce0a81bb67cc62be8d246092b161ba2b136172c52c179e907", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f415798635a4f6e8b6d851f2c2123c498cb25e078462c3c0a1004082cff7bbd0", + "context_projection_unavailable:contributor-scan:3ab7facfaa4cd10ca16053ec306e6962888b747fe49ef89ff79bcadcf5e3bb70", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ecc120f59e4f660cc723642b5e95001e4d0344f4e6b9be804ccfcea1e8c660a2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a69d683cb98ef2c861dd4c41f7c692f60153562a91e9b01c2ee6f35b0e20dae1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14e8cc89dd56f4c0651ab6ad6e332e10af11f958cc7c103a039e3c72252289f1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f07bb8ccd55cdb216b8f60548c9781a9ee0eefe8c8e4c05b4388b190745531f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dbf6f3e212c4b2978a52079885d98a4085275273389c741897ef21458f1b3f11", + "context_projection_unavailable:contributor-scan:6492afb1fb02c240530975a55c518a53b874fa0aabc294f34d766a2124d39e0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:52cce51367f7ee0cc67daabca3ec34f87aa9b653b1e83ac2ebc7e705df9a5e43", + "dynamic_external_or_depth_context_unresolved:contributor-scan:34889859c8fb27953e98d05f38bb1a6463a9fa951170f5f15bca1965798b5324", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ca24fd76494492c540dec50731e1f3f2fad7b12ad179b290c5058d848888551", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ffc4d0bb86bb420656808a48618b5436bece843489d784b7f86787346adafbc0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:11e7093ae7653371060c145b0d781632c41caffbf08c223629ee3cc4a391529e", + "context_projection_unavailable:contributor-scan:c651657e8974f950dc3d6e581195e8cfe57a399258f6f1f82d7f7d876dce8dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:23b88aa03880ab3162024b9becea54938f0d90e4972002fd62b8f591bc42d9e0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ed3a12d8909a3317b353f99f7d88c5cbbc0b58b710ae43a390e7feef7a80eb8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d9ad4ca3f1702e8707ab0eeda5897b99cdf582757b95c910c05ce554ba203a26", + "dynamic_external_or_depth_context_unresolved:contributor-scan:521b70aff590509d84e870cb73bf6755e626496c8155bdabe7cadf0eb103272c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:646259d5f7a2e4744a268bfa8cfa6f91698858b879148283a6869a7157278be1", + "context_projection_unavailable:contributor-scan:eef1eb61b520cc3f89e01099d4d70a163f5a52ef84c2e6c5e3e573c78f97f2d4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:de0deac1ceafe5571dfca090d72816404ea28ef882c6e0e6c42f983a9a74e921", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d126db9758e81e18bd72391c67aab4b2d298df91b4b20208a5b16612cb881c09", + "dynamic_external_or_depth_context_unresolved:contributor-scan:78381d168f3b08ce93ea86c44b812ef484bcdaf41348a9f806611a158e1cb811", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0fdaa18aee2b3260606b389c233c5b7270d99bacd7bcf2f71e23618c3d0b8cdf", + "dynamic_external_or_depth_context_unresolved:contributor-scan:354de5136d9efdb05ec889dfe6b202206aa274d1a51df3d6eb16279de09fbab5", + "context_projection_unavailable:contributor-scan:622ee10de5cd3c1e160b3fa1f65a75ea4a07d78e5a2a396990a773f7e99146e3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c131cba624d6d54312acd6b399f0064ca2ea93fe46530c8ff4cafb6224a8b20c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b872b5963d5de7e8b661764dde7d18d485795102bdd21dbf3507e7413a2f7d8e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ed7bef715318c8c7db340d2f3746763249d15046958cb3138f55509ec9c4f51", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3c2853baff5fef2f99377fe725da6449fdb9e46742733d4f7be2d230113a06a9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:584de909c4ed4d95cc3e488899673272438b79fc331ba8748e1dd57bf89667c8", + "context_projection_unavailable:contributor-scan:94ebde87ff4a01c118d2999be9c3b98989ade91d8b5440aa8888a42e2799c289", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e5b3fc3f6ffb3373bf6e6b1933090a12b5da87e616bf6e35f852e96d46435dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e189489e75ef2d51bfa86559788d694573bc08345b1a8678696850cece928576", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c053886de917306d7fbbce0cb345004c7c10989e5c4d6926edf4c81c81a4ef3c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e27fa218577b8e6546fb431dea7b9a841976c42a329fbad9ab9158ecebb1b7c6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bc93a6c420b2ae4796c808e67dde3f2effdaa3d6f20a2e38a96a318d99db070f", + "context_projection_unavailable:contributor-scan:513e2533c2c4bbca895209b0b1ebef24639bace7828a8679cc75726345ac78b9", + "context_projection_unavailable:contributor-scan:3510d0582f1e0af080a2ef700cfd9c5397e998263aeac009069d30f61dce7ad1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bcbc3f5da3e44a7969a0c750e6cf96d6075b7f169847f3ece87055e09aeb1d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c247c69a3d908f310267fb1c77dcd0f20d31ab1a00aa778ed235da5dfc987b62", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dae128866dd12dbec7d928626bd9582d2f9b78ab06ccf6ac3fc12cae7b1ec698", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fa1c65c1da178f489e1cd8d8589c2271864a95cdff1f10322b06801bda604dd6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:47eac5955f39bb0c4a533cd0095c5b2223b2aeca77bdb33baac04627b3cd12e6", + "context_projection_unavailable:contributor-scan:98c1e285b388077dc4d32fe7ae3cff0e540bc016607f20e643d3d073620f99e0", + "context_projection_unavailable:contributor-scan:31f5d8fd9b099334dd540e6aac7b70fab1e81c25fbb731054500f291cb8c0603", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d805d371b44b17806699d9cb3d8bd7d8d2d22067f2e4d7fba061427ce564c6ad", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4eebbb6c1f6210f428a3d423e401d370b16b2afed603b569ef10536658e6dae4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:25d5cc67b28aaf9814d125fbf4fb98fd90f55ac5fe3918ebd0249ae835b33d1f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:303416318ab062a2b1c59020a63e8efbc4af4a1e949b465f44a241d351e5eec4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e3f98f5df0de5761a5a9258164cc22835c61968f96355a4bb10081cd313269d", + "context_projection_unavailable:contributor-scan:2123b018bfe6dbb0dc3167db7da9e1a4f98a7f908094a37fd5c5d6b5269b08f2", + "context_projection_unavailable:contributor-scan:c5263033b79994e87f2a96eeedc1ffe891856cf008559d73de7c274498558204", + "context_projection_unavailable:contributor-scan:62c16e0c95e86a4b54b7390504cd23bebad7856f7304e9511802eb685198deb1", + "context_projection_unavailable:contributor-scan:63c1e59b1b3c3291f49bf6d172b032b6bf26fd5371d664ff263cf8d6867f6cb2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1957f95e46512d48b6d0115e628559af3c05dc637f47f659d11ebdd02aa161f0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f540d752aebf4f24a7a77ad21a646b97d48264ea5f2a9d11a6299909bdc9cf99", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4748964f12387843e2cdda59c64e76a9e74d67cb61fa1af6df7a939a316ffd7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3350c29581fb963c6a675573d9dc052e76994e62643377aefb1b2ee1a58f8df1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cf360556e591dffb5974c831c03f70f1281e69c98380b105ca8188c5f4d767dd", + "context_projection_unavailable:contributor-scan:06cef66cfe5e051dfca120f248201c33073d945d0205420eb09c521e06abbc7d", + "context_projection_unavailable:contributor-scan:af8584f0cf4fb1d014a1104acbbd17f62472bf1fad9452ca73e3baa304885721", + "dynamic_external_or_depth_context_unresolved:contributor-scan:27df8ddb8606a1cfdd09175c32246362b7ffa123b9df2ecd7ffcdaab62a6ad36", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4180a34b6b8ccdf598eb3fd98828a5ba1d442d9e2e7c232321f730e268723d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e249dd6972493deca73abb3109dc0ad1bfdb2b047ff9c04543664ccb1da27f79", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9bd191e88c8374e208a561659abe57f49a3c5bf27d6999064aa140d58935e00d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fbb50391449bb115384267947fd3baa34e4d6180d9d1bb3d8de5e9359ba09694", + "context_projection_unavailable:contributor-scan:ef3ba2bedf28f2c95f9ac176c3cb8245d16c26866dc36ecc69ded3db641202a5", + "context_projection_unavailable:contributor-scan:bcdf6aa6bf04f6bc147520c9337cd0db4b9f79a2c285649c3ab90d9fea82a638", + "dynamic_external_or_depth_context_unresolved:contributor-scan:919c40c0b3e55b97b571f0ba23620c4a6d4d44be705b9724941e65ad737b9863", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9dc32d66da54ff8cd80cead3e23aa1d5a93c414501be789ff55589e4232ee2b5", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7496541451be3c3dc3bc29233e93b2a1a3c0a0e7b35ac8e1f2f486996db69f69", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bdda0a24ccbfc31edae593bd1841e2badcd60c0f79a5c4f8244e9f1c2e1cac44", + "dynamic_external_or_depth_context_unresolved:contributor-scan:693467e9cb111e528b6bd901514e6656b210242d29ba0617577ee39cf653e7c4", + "context_projection_unavailable:contributor-scan:7b0896c2c356bdb439faf4ea8cdf81c8e9c87ef92860b629ca2da0e80a89e275", + "context_projection_unavailable:contributor-scan:b7afb181de2d3a5b6a45252c630f7a96638535b619611fa5b85f649590848051", + "dynamic_external_or_depth_context_unresolved:contributor-scan:efee23d66d1b9936dfec2a24ebe73f3fd90327b7a80de9085006dc6559b8d4e7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:80867748e8fdd10aa5f62e6401ff0b987cc7ffbde5099393573eaff7c097f37f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:832a954864c99a67d8abd16df26677c13df04d748688fb3c48c927229faacad4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:2ccf2b3af79ebcecda03456468e367867cbf114f1726276bf9cac0ee495a8e55", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7a6b32f2f167580649ff65a70b3e535dd4fe73a32f1cea91ec559a430c324884", + "context_projection_unavailable:contributor-scan:92b827aa15f8e2c1ef7b6c13d6b896ad1ac1bc25b7ba3b83bec87ed615ad631f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6454d100ccd5bed945f73029a8ea4475a8412f70a070cce125255da0dbf8bd91", + "dynamic_external_or_depth_context_unresolved:contributor-scan:784d747b13e9de6f9f70ee5d83445a8f5baac18e08b0a855eb85e069335405c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20e7fbf2d2242fd9d4e8fe5c6091544754d400655fdde69d394b5e2f736d589d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bb40f4beb2d3697ec775bb15465535eb3b724e893c0915ce2c1b8c2a9ff29c6d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b6bdbebfdc621c6c4fbd3cc6724f2c3b296b7c8a546ac7d1ed9daefae3507fec", + "context_projection_unavailable:contributor-scan:aa970f38bd46b99a481c8eaebcfd33a3bcd42f9c31666ec458a040542bfaea98", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1fa33c0cdff45776c710359a83282613898a10e5c71d3cbb465aead01e58fd2b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ad6e2417d62b70bad2bcb105c4d8f8d17d7d1571195daf920b00779f2ea4d215", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cb423a2f845a6b28d38d805c1f09707937cc4374fc579c0f7b8de705049e1adc", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a10e29aaab6144d3a0d715a2e98693730a9193c9fee19f3e44acf7229443f94e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:edfb8de993bed2b323de921deb9be5536f0458544d0cc852fb715d9cec8104dd", + "context_projection_unavailable:contributor-scan:4f2246b0f6f70dd4c31cb1845f69f30143eaefe29b2abe5d2be58534d36ee6e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f736c36848da99f8030dff35e2ff2027031292dc0aaa6b361330d6cdd33af8fe", + "dynamic_external_or_depth_context_unresolved:contributor-scan:aa8f3529c611bee3cdbf773af97f749765f600d2f8a2f1f1fabdee3b06f9c4f9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:62731b08944f863a2c1e5057553d675ecd923999636bb98110c2ea091005cd37", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f05bb1d81abbc24542d18c458d651dc030a18c68c3b80c00c5b0b71514277a8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:67b6471513e533f04498690e250b7d2c8d89f486287bb49285bbd60f26ecca6c", + "context_projection_unavailable:contributor-scan:1c5807271d348c25b20cc8e19261b725bfd6fe0201dfe2b59044566350aa01e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:86a9ebca54a92176dd0fadee7b171947eeddf72d1310c466becc2e98f1673b4b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5a857670d7d03dce6c50cba855a4018d22ea2dba9cef04231267bbac1e03e804", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4c3c322d7326ee46c43c2d7843f7be9dd4476cc42181a40b3113a374b5778c7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ade8bad6c32e72ce012d122c5ceb214720ac61701cfcf36585ab6fadee7f107", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ca1c3c566a0e0e25bda0e169e538629a628e69b05a9bd2bd6cb753726cc80f57", + "context_projection_unavailable:contributor-scan:82e0b710acb65d4bbcc79353bfee54d763e49d9936ad487e084eca188c18f3a4", + "context_projection_unavailable:contributor-scan:ec8fe6b8dd810451dc1b92970a23cb143eded7f93bd52bac6916db36af54ee14", + "dynamic_external_or_depth_context_unresolved:contributor-scan:92996194ab1a9b118bf50c494d94ee303a1c23919acea58f7b08e8e2c371931b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dd5375b8f5e47521bf03fd6390665fdf6e4de076a7fc3ac3fc16e1fe612e0628", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20f104d4519dfdf01bcdedf88e71c6bd66e425a63afe6c3534b3e039aa783cf1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a3d7b5ccb217d7470e6396fe1c094fde5081da30994ceaa62451a481f67fc351", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6ddff25ea01d52157b4d85f5f00246f86a66bb612fb976f0658e36bf2c98dbf2", + "context_projection_unavailable:contributor-scan:85b73d3a32e7962065be097c10c094d8f056ca1ceebadfbaaac240c923f1f745", + "context_projection_unavailable:contributor-scan:16028241773f90d6fc51cbbc844a6e134f576cc39191b47f6ce271314b62aa56", + "context_projection_unavailable:contributor-scan:c11140abfbdf2c84fa6b95cef075c03948de173780fba684d84d8068a5b6b4c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1cde41b32d7f94d9c80627b9d828506d47b60cd00ee7ed19cbd93953bcc4105b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:228e10358a44c1f1300b270ca1afc59fcda11da8ee6ffb29118395b6c1e605de", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dc51479873a7bd0c22e45a5999621450c29eddd251bdd9951c3983e6bde27c59", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e022b60204ac9d7b2eacc7631ac6597976ead5f133d8bb222ce0a45da120323", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b76d80c14c51dda075f7b5ea0a5f3ef7fc1caaa832b596822a15fd95f857536a", + "analysis_incomplete" + ], + "stage_timings": { + "deadline_seconds": 600.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.02336603298317641, + "provenance_seconds": 0.33120052504818887, + "snapshot_seconds": 0.10249989398289472, + "snapshot_reuses": 1, + "discovery_seconds": 0.9137105030240491, + "discovery_hits": 1, + "preparation_seconds": 1.0230771290371194, + "head_seconds": 87.43725184199866, + "base_seconds": 23.020315301953815, + "admission_seconds": 0.005260498030111194, + "cleanup_seconds": 0.0009351769695058465, + "graph_hits": 1, + "query_hits": 35, + "total_seconds": 111.87052142398898 + }, + "snapshot_bytes_read": 139164, + "classification": "recorded context/capability limits" + }, + { + "case_id": "VAmPI-BOLA", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-kyvk9pk7/objects.git", + "--base", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--head", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--artifact", + "/results/qualification-regression-v1/VAmPI-BOLA.json", + "--deadline", + "600.0", + "--cancellation-allowance", + "2", + "--max-regions", + "500", + "--cache-dir", + "/results/vampi-cache" + ], + "process_exit_code": 0, + "elapsed_seconds": 6.816393535002135, + "artifact": "VAmPI-BOLA.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Some checks are not enabled for normal alerts. Review capability coverage in the details.\nDetails: /results/qualification-regression-v1/VAmPI-BOLA.json\n", + "core_unchanged": true, + "input_pins": { + "base": "f16052dce83f05847133ec98f01c5193a41de7d8", + "head": "f16052dce83f05847133ec98f01c5193a41de7d8" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "capability_unavailable", + "comparison_unknown", + "witness_unresolved", + "dependency_unresolved", + "eligibility:eligibility_invalid_or_unavailable", + "witness_identity_unresolved", + "context_projection_unavailable:contributor-scan:b6e6786dce09d848d3bb498c168c49dda5c474537892ef6f9c7df68ebabdf550", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5fd8c7c2cb3416fe25b4c1437ea95ffba902e60407139a6b5d5c9d0a898beb17", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d3df6b543c4f932ffc44880f53a20d8e2a39b01aaed423c81c06fe8dff906acb", + "dynamic_external_or_depth_context_unresolved:contributor-scan:98d5d6114cd938cf0b0a384d35d279d5754c2aea55804b3dbb24a915753924b2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3aabf2177b0762d91115354177297f9b7fe6f3452c9c17ca2ff5a2cb03ecf98c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:68865c15daec49375f4bfb2f0acf7e48f45fd56909f137b1574b5ebf09d01095", + "context_projection_unavailable:contributor-scan:befb0ba6eeb35a1c34fbb30181339acb1c2b66c1ab373ef428b86208752dbd39", + "context_projection_unavailable:contributor-scan:7ac7cf444129e4df728e3ccf3f87cda6df1f45166d5f31acaa05c3bbf62f43ce", + "dynamic_external_or_depth_context_unresolved:contributor-scan:72b8e224c83e4e007aa6cab72f158df9b99f892db8994c65407e16ca4c929401", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b61225a697d36ca5907ae4c3100b8f155ec5a24c9039353d0688d37797cb5806", + "dynamic_external_or_depth_context_unresolved:contributor-scan:65d6f3f5eda2624c775b024e33bce4ca6cd7efa48b7a9060a2e9ecac2cb168d7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14a40f1cf8dd2eb92a31924cefc194cb364ee5e1c0f250740cdaaeaa45f7e222", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6d9cd82ed2b32c3d3d1852c65ac45a216f6e52e9a07bfab2501efbbeacd27a3e", + "context_projection_unavailable:contributor-scan:cdfa7ab2ac8e36fdd45cc472a83490c2fbd8b8ee141f08a82c0e4969c2c381c3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7856547fcb5c892066df29acbb3ef7da66b6179a92ae7aad8d8155ef3e48149b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:abd418304da4d1034dbdc261664c3cf83c35328940519ff14224fd69e5e4ee0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14536e658fd2e034c24c93c37b4cca1c8111c8e41831015e1212f2941f9b394f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7d88eb9dfc8a80dce0a81bb67cc62be8d246092b161ba2b136172c52c179e907", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f415798635a4f6e8b6d851f2c2123c498cb25e078462c3c0a1004082cff7bbd0", + "context_projection_unavailable:contributor-scan:3ab7facfaa4cd10ca16053ec306e6962888b747fe49ef89ff79bcadcf5e3bb70", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ecc120f59e4f660cc723642b5e95001e4d0344f4e6b9be804ccfcea1e8c660a2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a69d683cb98ef2c861dd4c41f7c692f60153562a91e9b01c2ee6f35b0e20dae1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14e8cc89dd56f4c0651ab6ad6e332e10af11f958cc7c103a039e3c72252289f1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f07bb8ccd55cdb216b8f60548c9781a9ee0eefe8c8e4c05b4388b190745531f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dbf6f3e212c4b2978a52079885d98a4085275273389c741897ef21458f1b3f11", + "context_projection_unavailable:contributor-scan:6492afb1fb02c240530975a55c518a53b874fa0aabc294f34d766a2124d39e0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:52cce51367f7ee0cc67daabca3ec34f87aa9b653b1e83ac2ebc7e705df9a5e43", + "dynamic_external_or_depth_context_unresolved:contributor-scan:34889859c8fb27953e98d05f38bb1a6463a9fa951170f5f15bca1965798b5324", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ca24fd76494492c540dec50731e1f3f2fad7b12ad179b290c5058d848888551", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ffc4d0bb86bb420656808a48618b5436bece843489d784b7f86787346adafbc0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:11e7093ae7653371060c145b0d781632c41caffbf08c223629ee3cc4a391529e", + "context_projection_unavailable:contributor-scan:c651657e8974f950dc3d6e581195e8cfe57a399258f6f1f82d7f7d876dce8dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:23b88aa03880ab3162024b9becea54938f0d90e4972002fd62b8f591bc42d9e0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ed3a12d8909a3317b353f99f7d88c5cbbc0b58b710ae43a390e7feef7a80eb8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d9ad4ca3f1702e8707ab0eeda5897b99cdf582757b95c910c05ce554ba203a26", + "dynamic_external_or_depth_context_unresolved:contributor-scan:521b70aff590509d84e870cb73bf6755e626496c8155bdabe7cadf0eb103272c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:646259d5f7a2e4744a268bfa8cfa6f91698858b879148283a6869a7157278be1", + "context_projection_unavailable:contributor-scan:eef1eb61b520cc3f89e01099d4d70a163f5a52ef84c2e6c5e3e573c78f97f2d4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:de0deac1ceafe5571dfca090d72816404ea28ef882c6e0e6c42f983a9a74e921", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d126db9758e81e18bd72391c67aab4b2d298df91b4b20208a5b16612cb881c09", + "dynamic_external_or_depth_context_unresolved:contributor-scan:78381d168f3b08ce93ea86c44b812ef484bcdaf41348a9f806611a158e1cb811", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0fdaa18aee2b3260606b389c233c5b7270d99bacd7bcf2f71e23618c3d0b8cdf", + "dynamic_external_or_depth_context_unresolved:contributor-scan:354de5136d9efdb05ec889dfe6b202206aa274d1a51df3d6eb16279de09fbab5", + "context_projection_unavailable:contributor-scan:622ee10de5cd3c1e160b3fa1f65a75ea4a07d78e5a2a396990a773f7e99146e3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c131cba624d6d54312acd6b399f0064ca2ea93fe46530c8ff4cafb6224a8b20c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b872b5963d5de7e8b661764dde7d18d485795102bdd21dbf3507e7413a2f7d8e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ed7bef715318c8c7db340d2f3746763249d15046958cb3138f55509ec9c4f51", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3c2853baff5fef2f99377fe725da6449fdb9e46742733d4f7be2d230113a06a9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:584de909c4ed4d95cc3e488899673272438b79fc331ba8748e1dd57bf89667c8", + "context_projection_unavailable:contributor-scan:94ebde87ff4a01c118d2999be9c3b98989ade91d8b5440aa8888a42e2799c289", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e5b3fc3f6ffb3373bf6e6b1933090a12b5da87e616bf6e35f852e96d46435dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e189489e75ef2d51bfa86559788d694573bc08345b1a8678696850cece928576", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c053886de917306d7fbbce0cb345004c7c10989e5c4d6926edf4c81c81a4ef3c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e27fa218577b8e6546fb431dea7b9a841976c42a329fbad9ab9158ecebb1b7c6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bc93a6c420b2ae4796c808e67dde3f2effdaa3d6f20a2e38a96a318d99db070f", + "context_projection_unavailable:contributor-scan:513e2533c2c4bbca895209b0b1ebef24639bace7828a8679cc75726345ac78b9", + "context_projection_unavailable:contributor-scan:3510d0582f1e0af080a2ef700cfd9c5397e998263aeac009069d30f61dce7ad1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bcbc3f5da3e44a7969a0c750e6cf96d6075b7f169847f3ece87055e09aeb1d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c247c69a3d908f310267fb1c77dcd0f20d31ab1a00aa778ed235da5dfc987b62", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dae128866dd12dbec7d928626bd9582d2f9b78ab06ccf6ac3fc12cae7b1ec698", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fa1c65c1da178f489e1cd8d8589c2271864a95cdff1f10322b06801bda604dd6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:47eac5955f39bb0c4a533cd0095c5b2223b2aeca77bdb33baac04627b3cd12e6", + "context_projection_unavailable:contributor-scan:98c1e285b388077dc4d32fe7ae3cff0e540bc016607f20e643d3d073620f99e0", + "context_projection_unavailable:contributor-scan:31f5d8fd9b099334dd540e6aac7b70fab1e81c25fbb731054500f291cb8c0603", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d805d371b44b17806699d9cb3d8bd7d8d2d22067f2e4d7fba061427ce564c6ad", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4eebbb6c1f6210f428a3d423e401d370b16b2afed603b569ef10536658e6dae4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:25d5cc67b28aaf9814d125fbf4fb98fd90f55ac5fe3918ebd0249ae835b33d1f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:303416318ab062a2b1c59020a63e8efbc4af4a1e949b465f44a241d351e5eec4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e3f98f5df0de5761a5a9258164cc22835c61968f96355a4bb10081cd313269d", + "context_projection_unavailable:contributor-scan:2123b018bfe6dbb0dc3167db7da9e1a4f98a7f908094a37fd5c5d6b5269b08f2", + "context_projection_unavailable:contributor-scan:c5263033b79994e87f2a96eeedc1ffe891856cf008559d73de7c274498558204", + "context_projection_unavailable:contributor-scan:62c16e0c95e86a4b54b7390504cd23bebad7856f7304e9511802eb685198deb1", + "context_projection_unavailable:contributor-scan:63c1e59b1b3c3291f49bf6d172b032b6bf26fd5371d664ff263cf8d6867f6cb2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1957f95e46512d48b6d0115e628559af3c05dc637f47f659d11ebdd02aa161f0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f540d752aebf4f24a7a77ad21a646b97d48264ea5f2a9d11a6299909bdc9cf99", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4748964f12387843e2cdda59c64e76a9e74d67cb61fa1af6df7a939a316ffd7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3350c29581fb963c6a675573d9dc052e76994e62643377aefb1b2ee1a58f8df1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cf360556e591dffb5974c831c03f70f1281e69c98380b105ca8188c5f4d767dd", + "context_projection_unavailable:contributor-scan:06cef66cfe5e051dfca120f248201c33073d945d0205420eb09c521e06abbc7d", + "context_projection_unavailable:contributor-scan:af8584f0cf4fb1d014a1104acbbd17f62472bf1fad9452ca73e3baa304885721", + "dynamic_external_or_depth_context_unresolved:contributor-scan:27df8ddb8606a1cfdd09175c32246362b7ffa123b9df2ecd7ffcdaab62a6ad36", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4180a34b6b8ccdf598eb3fd98828a5ba1d442d9e2e7c232321f730e268723d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e249dd6972493deca73abb3109dc0ad1bfdb2b047ff9c04543664ccb1da27f79", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9bd191e88c8374e208a561659abe57f49a3c5bf27d6999064aa140d58935e00d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fbb50391449bb115384267947fd3baa34e4d6180d9d1bb3d8de5e9359ba09694", + "context_projection_unavailable:contributor-scan:ef3ba2bedf28f2c95f9ac176c3cb8245d16c26866dc36ecc69ded3db641202a5", + "context_projection_unavailable:contributor-scan:bcdf6aa6bf04f6bc147520c9337cd0db4b9f79a2c285649c3ab90d9fea82a638", + "dynamic_external_or_depth_context_unresolved:contributor-scan:919c40c0b3e55b97b571f0ba23620c4a6d4d44be705b9724941e65ad737b9863", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9dc32d66da54ff8cd80cead3e23aa1d5a93c414501be789ff55589e4232ee2b5", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7496541451be3c3dc3bc29233e93b2a1a3c0a0e7b35ac8e1f2f486996db69f69", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bdda0a24ccbfc31edae593bd1841e2badcd60c0f79a5c4f8244e9f1c2e1cac44", + "dynamic_external_or_depth_context_unresolved:contributor-scan:693467e9cb111e528b6bd901514e6656b210242d29ba0617577ee39cf653e7c4", + "context_projection_unavailable:contributor-scan:7b0896c2c356bdb439faf4ea8cdf81c8e9c87ef92860b629ca2da0e80a89e275", + "context_projection_unavailable:contributor-scan:b7afb181de2d3a5b6a45252c630f7a96638535b619611fa5b85f649590848051", + "dynamic_external_or_depth_context_unresolved:contributor-scan:efee23d66d1b9936dfec2a24ebe73f3fd90327b7a80de9085006dc6559b8d4e7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:80867748e8fdd10aa5f62e6401ff0b987cc7ffbde5099393573eaff7c097f37f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:832a954864c99a67d8abd16df26677c13df04d748688fb3c48c927229faacad4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:2ccf2b3af79ebcecda03456468e367867cbf114f1726276bf9cac0ee495a8e55", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7a6b32f2f167580649ff65a70b3e535dd4fe73a32f1cea91ec559a430c324884", + "context_projection_unavailable:contributor-scan:92b827aa15f8e2c1ef7b6c13d6b896ad1ac1bc25b7ba3b83bec87ed615ad631f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6454d100ccd5bed945f73029a8ea4475a8412f70a070cce125255da0dbf8bd91", + "dynamic_external_or_depth_context_unresolved:contributor-scan:784d747b13e9de6f9f70ee5d83445a8f5baac18e08b0a855eb85e069335405c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20e7fbf2d2242fd9d4e8fe5c6091544754d400655fdde69d394b5e2f736d589d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bb40f4beb2d3697ec775bb15465535eb3b724e893c0915ce2c1b8c2a9ff29c6d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b6bdbebfdc621c6c4fbd3cc6724f2c3b296b7c8a546ac7d1ed9daefae3507fec", + "context_projection_unavailable:contributor-scan:aa970f38bd46b99a481c8eaebcfd33a3bcd42f9c31666ec458a040542bfaea98", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1fa33c0cdff45776c710359a83282613898a10e5c71d3cbb465aead01e58fd2b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ad6e2417d62b70bad2bcb105c4d8f8d17d7d1571195daf920b00779f2ea4d215", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cb423a2f845a6b28d38d805c1f09707937cc4374fc579c0f7b8de705049e1adc", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a10e29aaab6144d3a0d715a2e98693730a9193c9fee19f3e44acf7229443f94e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:edfb8de993bed2b323de921deb9be5536f0458544d0cc852fb715d9cec8104dd", + "context_projection_unavailable:contributor-scan:4f2246b0f6f70dd4c31cb1845f69f30143eaefe29b2abe5d2be58534d36ee6e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f736c36848da99f8030dff35e2ff2027031292dc0aaa6b361330d6cdd33af8fe", + "dynamic_external_or_depth_context_unresolved:contributor-scan:aa8f3529c611bee3cdbf773af97f749765f600d2f8a2f1f1fabdee3b06f9c4f9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:62731b08944f863a2c1e5057553d675ecd923999636bb98110c2ea091005cd37", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f05bb1d81abbc24542d18c458d651dc030a18c68c3b80c00c5b0b71514277a8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:67b6471513e533f04498690e250b7d2c8d89f486287bb49285bbd60f26ecca6c", + "context_projection_unavailable:contributor-scan:1c5807271d348c25b20cc8e19261b725bfd6fe0201dfe2b59044566350aa01e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:86a9ebca54a92176dd0fadee7b171947eeddf72d1310c466becc2e98f1673b4b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5a857670d7d03dce6c50cba855a4018d22ea2dba9cef04231267bbac1e03e804", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4c3c322d7326ee46c43c2d7843f7be9dd4476cc42181a40b3113a374b5778c7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ade8bad6c32e72ce012d122c5ceb214720ac61701cfcf36585ab6fadee7f107", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ca1c3c566a0e0e25bda0e169e538629a628e69b05a9bd2bd6cb753726cc80f57", + "context_projection_unavailable:contributor-scan:82e0b710acb65d4bbcc79353bfee54d763e49d9936ad487e084eca188c18f3a4", + "context_projection_unavailable:contributor-scan:ec8fe6b8dd810451dc1b92970a23cb143eded7f93bd52bac6916db36af54ee14", + "dynamic_external_or_depth_context_unresolved:contributor-scan:92996194ab1a9b118bf50c494d94ee303a1c23919acea58f7b08e8e2c371931b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dd5375b8f5e47521bf03fd6390665fdf6e4de076a7fc3ac3fc16e1fe612e0628", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20f104d4519dfdf01bcdedf88e71c6bd66e425a63afe6c3534b3e039aa783cf1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a3d7b5ccb217d7470e6396fe1c094fde5081da30994ceaa62451a481f67fc351", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6ddff25ea01d52157b4d85f5f00246f86a66bb612fb976f0658e36bf2c98dbf2", + "context_projection_unavailable:contributor-scan:85b73d3a32e7962065be097c10c094d8f056ca1ceebadfbaaac240c923f1f745", + "context_projection_unavailable:contributor-scan:16028241773f90d6fc51cbbc844a6e134f576cc39191b47f6ce271314b62aa56", + "context_projection_unavailable:contributor-scan:c11140abfbdf2c84fa6b95cef075c03948de173780fba684d84d8068a5b6b4c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1cde41b32d7f94d9c80627b9d828506d47b60cd00ee7ed19cbd93953bcc4105b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:228e10358a44c1f1300b270ca1afc59fcda11da8ee6ffb29118395b6c1e605de", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dc51479873a7bd0c22e45a5999621450c29eddd251bdd9951c3983e6bde27c59", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e022b60204ac9d7b2eacc7631ac6597976ead5f133d8bb222ce0a45da120323", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b76d80c14c51dda075f7b5ea0a5f3ef7fc1caaa832b596822a15fd95f857536a", + "analysis_incomplete" + ], + "stage_timings": { + "deadline_seconds": 600.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.01800786389503628, + "provenance_seconds": 0.2893215729855001, + "snapshot_seconds": 0.08405834203585982, + "snapshot_reuses": 1, + "discovery_seconds": 0.010119087994098663, + "discovery_hits": 2, + "preparation_seconds": 0.10081518208608031, + "head_seconds": 2.9955809990642592, + "base_seconds": 2.8868500230601057, + "admission_seconds": 0.00875066895969212, + "cleanup_seconds": 0.0011947620660066605, + "graph_hits": 2, + "query_hits": 403, + "total_seconds": 6.324697738979012 + }, + "snapshot_bytes_read": 139164, + "classification": "recorded context/capability limits" + }, + { + "case_id": "VAmPI-BOLA-BOOKS", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-kyvk9pk7/objects.git", + "--base", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--head", + "f16052dce83f05847133ec98f01c5193a41de7d8", + "--artifact", + "/results/qualification-regression-v1/VAmPI-BOLA-BOOKS.json", + "--deadline", + "600.0", + "--cancellation-allowance", + "2", + "--max-regions", + "500", + "--cache-dir", + "/results/vampi-cache" + ], + "process_exit_code": 0, + "elapsed_seconds": 6.684015898965299, + "artifact": "VAmPI-BOLA-BOOKS.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Some checks are not enabled for normal alerts. Review capability coverage in the details.\nDetails: /results/qualification-regression-v1/VAmPI-BOLA-BOOKS.json\n", + "core_unchanged": true, + "input_pins": { + "base": "f16052dce83f05847133ec98f01c5193a41de7d8", + "head": "f16052dce83f05847133ec98f01c5193a41de7d8" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "capability_unavailable", + "comparison_unknown", + "witness_unresolved", + "dependency_unresolved", + "eligibility:eligibility_invalid_or_unavailable", + "witness_identity_unresolved", + "context_projection_unavailable:contributor-scan:b6e6786dce09d848d3bb498c168c49dda5c474537892ef6f9c7df68ebabdf550", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5fd8c7c2cb3416fe25b4c1437ea95ffba902e60407139a6b5d5c9d0a898beb17", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d3df6b543c4f932ffc44880f53a20d8e2a39b01aaed423c81c06fe8dff906acb", + "dynamic_external_or_depth_context_unresolved:contributor-scan:98d5d6114cd938cf0b0a384d35d279d5754c2aea55804b3dbb24a915753924b2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3aabf2177b0762d91115354177297f9b7fe6f3452c9c17ca2ff5a2cb03ecf98c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:68865c15daec49375f4bfb2f0acf7e48f45fd56909f137b1574b5ebf09d01095", + "context_projection_unavailable:contributor-scan:befb0ba6eeb35a1c34fbb30181339acb1c2b66c1ab373ef428b86208752dbd39", + "context_projection_unavailable:contributor-scan:7ac7cf444129e4df728e3ccf3f87cda6df1f45166d5f31acaa05c3bbf62f43ce", + "dynamic_external_or_depth_context_unresolved:contributor-scan:72b8e224c83e4e007aa6cab72f158df9b99f892db8994c65407e16ca4c929401", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b61225a697d36ca5907ae4c3100b8f155ec5a24c9039353d0688d37797cb5806", + "dynamic_external_or_depth_context_unresolved:contributor-scan:65d6f3f5eda2624c775b024e33bce4ca6cd7efa48b7a9060a2e9ecac2cb168d7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14a40f1cf8dd2eb92a31924cefc194cb364ee5e1c0f250740cdaaeaa45f7e222", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6d9cd82ed2b32c3d3d1852c65ac45a216f6e52e9a07bfab2501efbbeacd27a3e", + "context_projection_unavailable:contributor-scan:cdfa7ab2ac8e36fdd45cc472a83490c2fbd8b8ee141f08a82c0e4969c2c381c3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7856547fcb5c892066df29acbb3ef7da66b6179a92ae7aad8d8155ef3e48149b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:abd418304da4d1034dbdc261664c3cf83c35328940519ff14224fd69e5e4ee0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14536e658fd2e034c24c93c37b4cca1c8111c8e41831015e1212f2941f9b394f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7d88eb9dfc8a80dce0a81bb67cc62be8d246092b161ba2b136172c52c179e907", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f415798635a4f6e8b6d851f2c2123c498cb25e078462c3c0a1004082cff7bbd0", + "context_projection_unavailable:contributor-scan:3ab7facfaa4cd10ca16053ec306e6962888b747fe49ef89ff79bcadcf5e3bb70", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ecc120f59e4f660cc723642b5e95001e4d0344f4e6b9be804ccfcea1e8c660a2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a69d683cb98ef2c861dd4c41f7c692f60153562a91e9b01c2ee6f35b0e20dae1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:14e8cc89dd56f4c0651ab6ad6e332e10af11f958cc7c103a039e3c72252289f1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f07bb8ccd55cdb216b8f60548c9781a9ee0eefe8c8e4c05b4388b190745531f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dbf6f3e212c4b2978a52079885d98a4085275273389c741897ef21458f1b3f11", + "context_projection_unavailable:contributor-scan:6492afb1fb02c240530975a55c518a53b874fa0aabc294f34d766a2124d39e0f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:52cce51367f7ee0cc67daabca3ec34f87aa9b653b1e83ac2ebc7e705df9a5e43", + "dynamic_external_or_depth_context_unresolved:contributor-scan:34889859c8fb27953e98d05f38bb1a6463a9fa951170f5f15bca1965798b5324", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ca24fd76494492c540dec50731e1f3f2fad7b12ad179b290c5058d848888551", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ffc4d0bb86bb420656808a48618b5436bece843489d784b7f86787346adafbc0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:11e7093ae7653371060c145b0d781632c41caffbf08c223629ee3cc4a391529e", + "context_projection_unavailable:contributor-scan:c651657e8974f950dc3d6e581195e8cfe57a399258f6f1f82d7f7d876dce8dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:23b88aa03880ab3162024b9becea54938f0d90e4972002fd62b8f591bc42d9e0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ed3a12d8909a3317b353f99f7d88c5cbbc0b58b710ae43a390e7feef7a80eb8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d9ad4ca3f1702e8707ab0eeda5897b99cdf582757b95c910c05ce554ba203a26", + "dynamic_external_or_depth_context_unresolved:contributor-scan:521b70aff590509d84e870cb73bf6755e626496c8155bdabe7cadf0eb103272c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:646259d5f7a2e4744a268bfa8cfa6f91698858b879148283a6869a7157278be1", + "context_projection_unavailable:contributor-scan:eef1eb61b520cc3f89e01099d4d70a163f5a52ef84c2e6c5e3e573c78f97f2d4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:de0deac1ceafe5571dfca090d72816404ea28ef882c6e0e6c42f983a9a74e921", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d126db9758e81e18bd72391c67aab4b2d298df91b4b20208a5b16612cb881c09", + "dynamic_external_or_depth_context_unresolved:contributor-scan:78381d168f3b08ce93ea86c44b812ef484bcdaf41348a9f806611a158e1cb811", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0fdaa18aee2b3260606b389c233c5b7270d99bacd7bcf2f71e23618c3d0b8cdf", + "dynamic_external_or_depth_context_unresolved:contributor-scan:354de5136d9efdb05ec889dfe6b202206aa274d1a51df3d6eb16279de09fbab5", + "context_projection_unavailable:contributor-scan:622ee10de5cd3c1e160b3fa1f65a75ea4a07d78e5a2a396990a773f7e99146e3", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c131cba624d6d54312acd6b399f0064ca2ea93fe46530c8ff4cafb6224a8b20c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b872b5963d5de7e8b661764dde7d18d485795102bdd21dbf3507e7413a2f7d8e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:0ed7bef715318c8c7db340d2f3746763249d15046958cb3138f55509ec9c4f51", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3c2853baff5fef2f99377fe725da6449fdb9e46742733d4f7be2d230113a06a9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:584de909c4ed4d95cc3e488899673272438b79fc331ba8748e1dd57bf89667c8", + "context_projection_unavailable:contributor-scan:94ebde87ff4a01c118d2999be9c3b98989ade91d8b5440aa8888a42e2799c289", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e5b3fc3f6ffb3373bf6e6b1933090a12b5da87e616bf6e35f852e96d46435dff", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e189489e75ef2d51bfa86559788d694573bc08345b1a8678696850cece928576", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c053886de917306d7fbbce0cb345004c7c10989e5c4d6926edf4c81c81a4ef3c", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e27fa218577b8e6546fb431dea7b9a841976c42a329fbad9ab9158ecebb1b7c6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bc93a6c420b2ae4796c808e67dde3f2effdaa3d6f20a2e38a96a318d99db070f", + "context_projection_unavailable:contributor-scan:513e2533c2c4bbca895209b0b1ebef24639bace7828a8679cc75726345ac78b9", + "context_projection_unavailable:contributor-scan:3510d0582f1e0af080a2ef700cfd9c5397e998263aeac009069d30f61dce7ad1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bcbc3f5da3e44a7969a0c750e6cf96d6075b7f169847f3ece87055e09aeb1d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:c247c69a3d908f310267fb1c77dcd0f20d31ab1a00aa778ed235da5dfc987b62", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dae128866dd12dbec7d928626bd9582d2f9b78ab06ccf6ac3fc12cae7b1ec698", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fa1c65c1da178f489e1cd8d8589c2271864a95cdff1f10322b06801bda604dd6", + "dynamic_external_or_depth_context_unresolved:contributor-scan:47eac5955f39bb0c4a533cd0095c5b2223b2aeca77bdb33baac04627b3cd12e6", + "context_projection_unavailable:contributor-scan:98c1e285b388077dc4d32fe7ae3cff0e540bc016607f20e643d3d073620f99e0", + "context_projection_unavailable:contributor-scan:31f5d8fd9b099334dd540e6aac7b70fab1e81c25fbb731054500f291cb8c0603", + "dynamic_external_or_depth_context_unresolved:contributor-scan:d805d371b44b17806699d9cb3d8bd7d8d2d22067f2e4d7fba061427ce564c6ad", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4eebbb6c1f6210f428a3d423e401d370b16b2afed603b569ef10536658e6dae4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:25d5cc67b28aaf9814d125fbf4fb98fd90f55ac5fe3918ebd0249ae835b33d1f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:303416318ab062a2b1c59020a63e8efbc4af4a1e949b465f44a241d351e5eec4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e3f98f5df0de5761a5a9258164cc22835c61968f96355a4bb10081cd313269d", + "context_projection_unavailable:contributor-scan:2123b018bfe6dbb0dc3167db7da9e1a4f98a7f908094a37fd5c5d6b5269b08f2", + "context_projection_unavailable:contributor-scan:c5263033b79994e87f2a96eeedc1ffe891856cf008559d73de7c274498558204", + "context_projection_unavailable:contributor-scan:62c16e0c95e86a4b54b7390504cd23bebad7856f7304e9511802eb685198deb1", + "context_projection_unavailable:contributor-scan:63c1e59b1b3c3291f49bf6d172b032b6bf26fd5371d664ff263cf8d6867f6cb2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1957f95e46512d48b6d0115e628559af3c05dc637f47f659d11ebdd02aa161f0", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f540d752aebf4f24a7a77ad21a646b97d48264ea5f2a9d11a6299909bdc9cf99", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4748964f12387843e2cdda59c64e76a9e74d67cb61fa1af6df7a939a316ffd7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3350c29581fb963c6a675573d9dc052e76994e62643377aefb1b2ee1a58f8df1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cf360556e591dffb5974c831c03f70f1281e69c98380b105ca8188c5f4d767dd", + "context_projection_unavailable:contributor-scan:06cef66cfe5e051dfca120f248201c33073d945d0205420eb09c521e06abbc7d", + "context_projection_unavailable:contributor-scan:af8584f0cf4fb1d014a1104acbbd17f62472bf1fad9452ca73e3baa304885721", + "dynamic_external_or_depth_context_unresolved:contributor-scan:27df8ddb8606a1cfdd09175c32246362b7ffa123b9df2ecd7ffcdaab62a6ad36", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4180a34b6b8ccdf598eb3fd98828a5ba1d442d9e2e7c232321f730e268723d5f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:e249dd6972493deca73abb3109dc0ad1bfdb2b047ff9c04543664ccb1da27f79", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9bd191e88c8374e208a561659abe57f49a3c5bf27d6999064aa140d58935e00d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:fbb50391449bb115384267947fd3baa34e4d6180d9d1bb3d8de5e9359ba09694", + "context_projection_unavailable:contributor-scan:ef3ba2bedf28f2c95f9ac176c3cb8245d16c26866dc36ecc69ded3db641202a5", + "context_projection_unavailable:contributor-scan:bcdf6aa6bf04f6bc147520c9337cd0db4b9f79a2c285649c3ab90d9fea82a638", + "dynamic_external_or_depth_context_unresolved:contributor-scan:919c40c0b3e55b97b571f0ba23620c4a6d4d44be705b9724941e65ad737b9863", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9dc32d66da54ff8cd80cead3e23aa1d5a93c414501be789ff55589e4232ee2b5", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7496541451be3c3dc3bc29233e93b2a1a3c0a0e7b35ac8e1f2f486996db69f69", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bdda0a24ccbfc31edae593bd1841e2badcd60c0f79a5c4f8244e9f1c2e1cac44", + "dynamic_external_or_depth_context_unresolved:contributor-scan:693467e9cb111e528b6bd901514e6656b210242d29ba0617577ee39cf653e7c4", + "context_projection_unavailable:contributor-scan:7b0896c2c356bdb439faf4ea8cdf81c8e9c87ef92860b629ca2da0e80a89e275", + "context_projection_unavailable:contributor-scan:b7afb181de2d3a5b6a45252c630f7a96638535b619611fa5b85f649590848051", + "dynamic_external_or_depth_context_unresolved:contributor-scan:efee23d66d1b9936dfec2a24ebe73f3fd90327b7a80de9085006dc6559b8d4e7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:80867748e8fdd10aa5f62e6401ff0b987cc7ffbde5099393573eaff7c097f37f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:832a954864c99a67d8abd16df26677c13df04d748688fb3c48c927229faacad4", + "dynamic_external_or_depth_context_unresolved:contributor-scan:2ccf2b3af79ebcecda03456468e367867cbf114f1726276bf9cac0ee495a8e55", + "dynamic_external_or_depth_context_unresolved:contributor-scan:7a6b32f2f167580649ff65a70b3e535dd4fe73a32f1cea91ec559a430c324884", + "context_projection_unavailable:contributor-scan:92b827aa15f8e2c1ef7b6c13d6b896ad1ac1bc25b7ba3b83bec87ed615ad631f", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6454d100ccd5bed945f73029a8ea4475a8412f70a070cce125255da0dbf8bd91", + "dynamic_external_or_depth_context_unresolved:contributor-scan:784d747b13e9de6f9f70ee5d83445a8f5baac18e08b0a855eb85e069335405c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20e7fbf2d2242fd9d4e8fe5c6091544754d400655fdde69d394b5e2f736d589d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:bb40f4beb2d3697ec775bb15465535eb3b724e893c0915ce2c1b8c2a9ff29c6d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b6bdbebfdc621c6c4fbd3cc6724f2c3b296b7c8a546ac7d1ed9daefae3507fec", + "context_projection_unavailable:contributor-scan:aa970f38bd46b99a481c8eaebcfd33a3bcd42f9c31666ec458a040542bfaea98", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1fa33c0cdff45776c710359a83282613898a10e5c71d3cbb465aead01e58fd2b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ad6e2417d62b70bad2bcb105c4d8f8d17d7d1571195daf920b00779f2ea4d215", + "dynamic_external_or_depth_context_unresolved:contributor-scan:cb423a2f845a6b28d38d805c1f09707937cc4374fc579c0f7b8de705049e1adc", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a10e29aaab6144d3a0d715a2e98693730a9193c9fee19f3e44acf7229443f94e", + "dynamic_external_or_depth_context_unresolved:contributor-scan:edfb8de993bed2b323de921deb9be5536f0458544d0cc852fb715d9cec8104dd", + "context_projection_unavailable:contributor-scan:4f2246b0f6f70dd4c31cb1845f69f30143eaefe29b2abe5d2be58534d36ee6e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:f736c36848da99f8030dff35e2ff2027031292dc0aaa6b361330d6cdd33af8fe", + "dynamic_external_or_depth_context_unresolved:contributor-scan:aa8f3529c611bee3cdbf773af97f749765f600d2f8a2f1f1fabdee3b06f9c4f9", + "dynamic_external_or_depth_context_unresolved:contributor-scan:62731b08944f863a2c1e5057553d675ecd923999636bb98110c2ea091005cd37", + "dynamic_external_or_depth_context_unresolved:contributor-scan:9f05bb1d81abbc24542d18c458d651dc030a18c68c3b80c00c5b0b71514277a8", + "dynamic_external_or_depth_context_unresolved:contributor-scan:67b6471513e533f04498690e250b7d2c8d89f486287bb49285bbd60f26ecca6c", + "context_projection_unavailable:contributor-scan:1c5807271d348c25b20cc8e19261b725bfd6fe0201dfe2b59044566350aa01e2", + "dynamic_external_or_depth_context_unresolved:contributor-scan:86a9ebca54a92176dd0fadee7b171947eeddf72d1310c466becc2e98f1673b4b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:5a857670d7d03dce6c50cba855a4018d22ea2dba9cef04231267bbac1e03e804", + "dynamic_external_or_depth_context_unresolved:contributor-scan:4c3c322d7326ee46c43c2d7843f7be9dd4476cc42181a40b3113a374b5778c7d", + "dynamic_external_or_depth_context_unresolved:contributor-scan:3ade8bad6c32e72ce012d122c5ceb214720ac61701cfcf36585ab6fadee7f107", + "dynamic_external_or_depth_context_unresolved:contributor-scan:ca1c3c566a0e0e25bda0e169e538629a628e69b05a9bd2bd6cb753726cc80f57", + "context_projection_unavailable:contributor-scan:82e0b710acb65d4bbcc79353bfee54d763e49d9936ad487e084eca188c18f3a4", + "context_projection_unavailable:contributor-scan:ec8fe6b8dd810451dc1b92970a23cb143eded7f93bd52bac6916db36af54ee14", + "dynamic_external_or_depth_context_unresolved:contributor-scan:92996194ab1a9b118bf50c494d94ee303a1c23919acea58f7b08e8e2c371931b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dd5375b8f5e47521bf03fd6390665fdf6e4de076a7fc3ac3fc16e1fe612e0628", + "dynamic_external_or_depth_context_unresolved:contributor-scan:20f104d4519dfdf01bcdedf88e71c6bd66e425a63afe6c3534b3e039aa783cf1", + "dynamic_external_or_depth_context_unresolved:contributor-scan:a3d7b5ccb217d7470e6396fe1c094fde5081da30994ceaa62451a481f67fc351", + "dynamic_external_or_depth_context_unresolved:contributor-scan:6ddff25ea01d52157b4d85f5f00246f86a66bb612fb976f0658e36bf2c98dbf2", + "context_projection_unavailable:contributor-scan:85b73d3a32e7962065be097c10c094d8f056ca1ceebadfbaaac240c923f1f745", + "context_projection_unavailable:contributor-scan:16028241773f90d6fc51cbbc844a6e134f576cc39191b47f6ce271314b62aa56", + "context_projection_unavailable:contributor-scan:c11140abfbdf2c84fa6b95cef075c03948de173780fba684d84d8068a5b6b4c7", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1cde41b32d7f94d9c80627b9d828506d47b60cd00ee7ed19cbd93953bcc4105b", + "dynamic_external_or_depth_context_unresolved:contributor-scan:228e10358a44c1f1300b270ca1afc59fcda11da8ee6ffb29118395b6c1e605de", + "dynamic_external_or_depth_context_unresolved:contributor-scan:dc51479873a7bd0c22e45a5999621450c29eddd251bdd9951c3983e6bde27c59", + "dynamic_external_or_depth_context_unresolved:contributor-scan:1e022b60204ac9d7b2eacc7631ac6597976ead5f133d8bb222ce0a45da120323", + "dynamic_external_or_depth_context_unresolved:contributor-scan:b76d80c14c51dda075f7b5ea0a5f3ef7fc1caaa832b596822a15fd95f857536a", + "analysis_incomplete" + ], + "stage_timings": { + "deadline_seconds": 600.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.017163134994916618, + "provenance_seconds": 0.27999858604744077, + "snapshot_seconds": 0.07985386403743178, + "snapshot_reuses": 1, + "discovery_seconds": 0.010372382937930524, + "discovery_hits": 2, + "preparation_seconds": 0.09698529110755771, + "head_seconds": 2.9751758010825142, + "base_seconds": 2.7918961899122223, + "admission_seconds": 0.005823700921609998, + "cleanup_seconds": 0.0009863880695775151, + "graph_hits": 2, + "query_hits": 403, + "total_seconds": 6.191919289063662 + }, + "snapshot_bytes_read": 139164, + "classification": "recorded context/capability limits" + } + ], + "core_changes": [], + "adapter_changes": [], + "freeze_after_pmpro": null + } + }, + "qualification-envelope-v1": { + "decision": { + "decision": "NO-GO", + "capabilities_enabled": false, + "scorecard": "scorecard.json", + "reason": "Qualification evidence run; independent eligibility and joint quality/warm-latency gates remain unmet.", + "selection": "envelope", + "analysis_deadline_seconds": 30, + "recorded_cases": 1, + "declared_population": 11, + "core_unchanged": true, + "adapter_changes": [], + "limits": [ + "No warm-cache measurements", + "Untouched Ghost population not scanned", + "PHP/Python admission populations missing", + "libpng retained as unsupported envelope; no C/C++ detection claim", + "Zero normal alerts from an empty registry cannot establish precision or useful recall" + ] + }, + "metrics": { + "schema_version": 1, + "profile_sha256": "0617fe024d11816568cc77c078b22c3f59b272125d4f4688b8e31b1ec8c9a854", + "population": 11, + "recorded_cases": 1, + "measurement_status": "recorded", + "metrics": { + "recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 2, + "value": null, + "wilson95": null, + "unobserved": 2 + }, + "completion": { + "numerator": 0, + "denominator": 9, + "value": 0.0, + "wilson95": [ + 0.0, + 0.2991450484195441 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 9 + }, + "latency": { + "cold": { + "samples": 1, + "p50": 30.589514696970582, + "p95": 30.589514696970582 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 11, + "timeouts": 1 + }, + "by_capability": { + "c/libpng/memory_safety": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 1, + "p50": 30.589514696970582, + "p95": 30.589514696970582 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 1 + }, + "javascript/express/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": null, + "wilson95": null, + "unobserved": 1 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 3 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 0 + }, + "javascript/express/unreviewed": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "php/wordpress/injection": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": null, + "wilson95": null, + "unobserved": 1 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 3 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 0 + }, + "python/flask/access_control": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 2, + "value": 0.0, + "wilson95": [ + 0.0, + 0.6576197724933469 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 2 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 2, + "timeouts": 0 + }, + "python/flask/injection": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 1 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + } + }, + "admission": "experimental", + "gates_passed": false, + "note": "Diagnostic instrument only. No admission without independent capability evaluation. Missing runs contribute only conservative full-population bounds, not observed detector performance. Witness association is checked; semantic/actionability review is supplied evidence, not inferred from rank." + }, + "cases": [ + { + "id": "pmpro-introduce", + "base": "pmpro-fixed", + "tip": "pmpro-vulnerable", + "label": "vulnerable", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-repair", + "base": "pmpro-vulnerable", + "tip": "pmpro-fixed", + "label": "fixed", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "PMPro upstream2.9.7 to2.9.8 parameter binding fix for CVE-2023-23488.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "pmpro-benign", + "base": "pmpro-vulnerable", + "tip": "pmpro-benign", + "label": "benign", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-introduce", + "base": "nodegoat-fixed", + "tip": "nodegoat-vulnerable", + "label": "vulnerable", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-repair", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-fixed", + "label": "fixed", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replacement of three eval calls with Number conversion; source tutorial also documents alternate numeric parsing.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "nodegoat-benign", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-benign", + "label": "benign", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "ready", + "input_problem": null + }, + { + "id": "VAmPI-SQLI", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/injection", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA-BOOKS", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "libpng-CVE-2025-66293", + "base": "libpng-envelope", + "tip": "libpng-envelope", + "label": "unsupported", + "role": "envelope", + "capability": "c/libpng/memory_safety", + "provenance": "Arithmetic/bounds is outside the current abstract domain; measures graph/cost envelope only.", + "prerequisites": [], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "unsupported population; no detection claim", + "input_status": "ready", + "input_problem": null + }, + { + "id": "ghost-reserved-population", + "base": "ghost-reserved", + "tip": "ghost-reserved", + "label": "unreviewed", + "role": "reserved_holdout", + "capability": "javascript/express/unreviewed", + "provenance": "Reserved from production API/module/async shape and public security-fix history before scanner results. Manifest6.64.0-rc.0, Express4.22.2. Not an ESM or Express5 coverage claim.", + "prerequisites": [ + "Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.", + "Freeze core and existing facts after development; preserve reservation and record any contamination." + ], + "outcome": "unresolved", + "reached_transitively": false, + "witnesses": [], + "complete": false, + "problem": "no recorded execution", + "input_status": "missing_prerequisite", + "input_problem": "ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.; Freeze core and existing facts after development; preserve reservation and record any contamination." + } + ], + "execution": { + "cases": [ + { + "case_id": "libpng-CVE-2025-66293", + "command": [ + "ousast", + "pre-push", + "/tmp/ousast-experiment-sh9w12sd/objects.git", + "--base", + "cf53e54ccf631d8de68a30ebb3b8eeed1d6f1a08", + "--head", + "cf53e54ccf631d8de68a30ebb3b8eeed1d6f1a08", + "--artifact", + "/results/qualification-envelope-v1/libpng-CVE-2025-66293.json", + "--deadline", + "30", + "--cancellation-allowance", + "2", + "--max-regions", + "500" + ], + "process_exit_code": 0, + "elapsed_seconds": 30.589514696970582, + "artifact": "libpng-CVE-2025-66293.json", + "terminal": "No actionable defects reported; analysis is incomplete.\nNotice: Analysis did not finish. Rerun with a longer analysis deadline.\nDetails: /results/qualification-envelope-v1/libpng-CVE-2025-66293.json\n", + "core_unchanged": true, + "input_pins": { + "base": "cf53e54ccf631d8de68a30ebb3b8eeed1d6f1a08", + "head": "cf53e54ccf631d8de68a30ebb3b8eeed1d6f1a08" + }, + "runtime_provenance_available": true, + "coverage_reasons": [ + "deadline_exhausted", + "admission_failed:TimeoutError", + "cpg_build_failed", + "cross_partition_semantics_unresolved", + "analysis_incomplete", + "base_comparison_unavailable" + ], + "stage_timings": { + "deadline_seconds": 30.0, + "cancellation_allowance_seconds": 2.0, + "resolution_seconds": 0.015835126978345215, + "provenance_seconds": 0.2793400720693171, + "snapshot_seconds": 2.2742549009853974, + "snapshot_reuses": 1, + "discovery_seconds": 18.499541006982327, + "discovery_hits": 0, + "preparation_seconds": 20.78126169706229, + "head_seconds": 8.948544265003875, + "base_seconds": 0.0002519360277801752, + "admission_seconds": 0.018592773005366325, + "graph_hits": 0, + "query_hits": 0, + "total_seconds": 30.06640503089875 + }, + "snapshot_bytes_read": 12546454, + "classification": "scope/deadline" + } + ], + "core_changes": [], + "adapter_changes": [], + "freeze_after_pmpro": null + } + } + }, + "limitations": [ + "Ghost reviewed independent population and local checkout missing; not scanned.", + "PHP/Python independent qualification populations missing.", + "No reviewed emitted alerts: precision undefined, no admission.", + "VAmPI lab budget 600s cannot qualify 30s hook latency; same-snapshot regression is not a security-change pair.", + "No transitive detection claimed unless associated query carries the path witness.", + "libpng arithmetic/bounds remains unsupported; no C/C++ detection claim.", + "Registry-generation provenance probe overlapped the start of the VAmPI lab run; lab timings are diagnostic, not runtime-gate samples.", + "8.2 runtime evidence predates the eligibility-policy addition and remains failed/stale for admission; never relabeled." + ] +} diff --git a/benchmarks/measurements/2026-09-13-push-qualification.json.gz b/benchmarks/measurements/2026-09-13-push-qualification.json.gz new file mode 100644 index 0000000..bf82a17 Binary files /dev/null and b/benchmarks/measurements/2026-09-13-push-qualification.json.gz differ diff --git a/benchmarks/push/README.md b/benchmarks/push/README.md index 9d05e05..b90f8a8 100644 --- a/benchmarks/push/README.md +++ b/benchmarks/push/README.md @@ -188,3 +188,27 @@ reports nearest-rank p50/p95 with sample counts, and never treats no answers as Exit 1 with a complete scorecard is measured NO-GO; a missing scorecard is an instrument failure. Three samples per workload on development NodeGoat cannot independently qualify a production language/framework/family or establish broad multi-project performance. + +### Capability qualification (task 8.3) + +The same `measure.py` replay instrument accepts `--selection development` (the +six PMPro/NodeGoat changes), `--selection regression` (three VAmPI targets), or +`--selection envelope` (libpng). Each profile retains the full declared population. +Readable regression snapshots may execute while their missing independent evaluation +prerequisites remain unresolved. `--deadline 600 --cache-dir /results/lab-cache` +is a separately frozen laboratory experiment, never a replacement for the 30-second +hook profile. A ranked or directly detected VAmPI target does not prove a transitive path. + +`qualify_registry.py --evidence DIR --runtime SCORECARD --out NEW_FILE` recomputes +eligibility from the frozen profile, validated inputs, actual run and runtime scorecard. +Without `--declarations` it creates explicitly unreviewed, experimental declarations. +A reviewed declaration must match its frozen capability key, operation symbols, advice, +review identity, untouched workload and exact installed analysis semantics; all quality, +completion and runtime gates must pass. Synthetic positive controls in the unit suite +verify this contract and do not qualify real capabilities. + +The installed `openultrasast/push/eligibility.json` is a trusted release input, not +repository configuration. The runner recomputes its decision and rejects stale or +modified evidence. This integrity check is not a cryptographic reviewer signature. +The versioned NO-GO registry enables no capability. Regenerate evidence after changes +to core, engine, facts, queries, policy or semantics; do not relabel old measurements. diff --git a/benchmarks/push/measure.py b/benchmarks/push/measure.py index 2f8bb1f..eb80f71 100644 --- a/benchmarks/push/measure.py +++ b/benchmarks/push/measure.py @@ -163,31 +163,44 @@ def main() -> int: parser.add_argument("--manifest", type=Path, required=True) parser.add_argument("--cache", type=Path, required=True) parser.add_argument("--out", type=Path, required=True) + parser.add_argument("--selection", choices=("development", "regression", "envelope"), default="development") + parser.add_argument("--deadline", type=float, default=30) + parser.add_argument("--cache-dir", type=Path) args = parser.parse_args() + if args.deadline <= 0: + parser.error("deadline must be positive") args.out.mkdir(parents=True, exist_ok=False) manifest = json.loads(args.manifest.read_bytes()) validation = validate_manifest(args.manifest, cache_root=args.cache, fetch=False) write(args.out / "input-validation.json", validation) settings = ScanBudget(max_model_calls=0, max_regions=500, order_by_evidence=True) initial = _provenance(args.manifest.parent, settings) - keys = ("ranking_mode", "engine", "facts", "queries", "policy", "core") + keys = ("ranking_mode", "engine", "engine_runtime", "facts", "queries", "policy", "core", "semantics") config = {key: initial[key] for key in keys} config.update( - version="first-replay-v2-2026-09-13", + version="qualification-replay-v1-" + args.selection, scope="full tracked tree; declared first-party graph/target exclusions; evidence ranker", hardware=platform.platform(), - budget_seconds=30, + budget_seconds=args.deadline, targets=json.loads((args.manifest.parent / "diagnostic-config-v1.json").read_text())["targets"], ) profile = freeze_profile(args.manifest.read_bytes(), config) write(args.out / "profile.json", profile) # Freeze on disk BEFORE any measurement. run = {"profile_sha256": profile["profile_sha256"], "context": dict(config), "records": []} evidence = {"cases": [], "core_changes": [], "adapter_changes": [], "freeze_after_pmpro": None} - ready = {c["id"]: c["status"] == "ready" for c in validation["cases"]} + valid_snapshots = {s["id"] for s in validation["snapshots"] if s["status"] == "ready"} + ready = { + c["id"]: c["status"] == "ready" or (c["label"] == "regression" and c["base"] in valid_snapshots and c["tip"] in valid_snapshots) + for c in validation["cases"] + } snapshots = {s["id"]: s for s in manifest["snapshots"]} # Fixed declared order; reserved, regression and unsupported populations stay # in the joint scorer without scanning or tuning on the holdout. cases = [c for prefix in ("pmpro-", "nodegoat-") for c in manifest["cases"] if c["id"].startswith(prefix)] + if args.selection == "regression": + cases = [c for c in manifest["cases"] if c["label"] == "regression"] + elif args.selection == "envelope": + cases = [c for c in manifest["cases"] if c["label"] == "unsupported"] with tempfile.TemporaryDirectory(prefix="ousast-experiment-") as temporary: bare = Path(temporary) / "objects.git" bare.mkdir() @@ -209,6 +222,7 @@ def main() -> int: args.out / "replay-pins.json", {"snapshots": pins, "provenance": "Full upstream trees; declared authored edits in a private bare Git repository."}, ) + seen_comparisons = set() for case in cases: if not ready[case["id"]]: evidence["cases"].append({"case_id": case["id"], "status": "missing_input_prerequisite"}) @@ -231,14 +245,16 @@ def main() -> int: "--artifact", str(artifact_path), "--deadline", - "30", + str(args.deadline), "--cancellation-allowance", "2", "--max-regions", "500", ] + if args.cache_dir is not None: + command += ["--cache-dir", str(args.cache_dir)] start = time.monotonic() - process = subprocess.run(command, capture_output=True, text=True, timeout=62) + process = subprocess.run(command, capture_output=True, text=True, timeout=args.deadline + 5) elapsed = time.monotonic() - start (args.out / (case["id"] + ".stdout")).write_text(process.stdout) (args.out / (case["id"] + ".stderr")).write_text(process.stderr) @@ -257,7 +273,11 @@ def main() -> int: # Unmeasured provenance caused by preparation timeout is explicit; # never replace it with a fictitious runtime measurement. entry["runtime_provenance_available"] = all(artifact["provenance"].get(key) == initial[key] for key in keys) - record = execution_record(case["id"], artifact, elapsed=elapsed, target=config["targets"][case["id"]]) + record = execution_record(case["id"], artifact, elapsed=elapsed, target=config["targets"].get(case["id"])) + comparison = (pins[case["base"]], pins[case["tip"]]) + if args.cache_dir is not None and comparison in seen_comparisons and artifact["timings"].get("graph_hits", 0) >= 2: + record["cache_state"] = "identical_tip" + seen_comparisons.add(comparison) entry["coverage_reasons"] = artifact["admission"]["coverage_reasons"] entry["stage_timings"] = artifact["timings"] entry["snapshot_bytes_read"] = sum(s["bytes_read"] for s in artifact["snapshots"]) @@ -291,13 +311,15 @@ def main() -> int: "decision": "NO-GO", "capabilities_enabled": False, "scorecard": "scorecard.json", - "reason": "First cold diagnostic experiment; independent eligibility and joint quality/warm-latency gates remain unmet.", + "reason": "Qualification evidence run; independent eligibility and joint quality/warm-latency gates remain unmet.", + "selection": args.selection, + "analysis_deadline_seconds": args.deadline, "recorded_cases": len(run["records"]), "declared_population": len(manifest["cases"]), "core_unchanged": True, "adapter_changes": [], "limits": [ - "No warm-cache measurements", + "No representative warm changed-code measurements; identical-comparison reuse is reported separately", "Untouched Ghost population not scanned", "PHP/Python admission populations missing", "libpng retained as unsupported envelope; no C/C++ detection claim", diff --git a/benchmarks/push/qualify_registry.py b/benchmarks/push/qualify_registry.py new file mode 100644 index 0000000..09bef9d --- /dev/null +++ b/benchmarks/push/qualify_registry.py @@ -0,0 +1,73 @@ +"""Recompute versioned eligibility from frozen results; default declarations are experimental.""" + +from __future__ import annotations + +import argparse +import json +from pathlib import Path + +from openultrasast.model.scan import ScanBudget +from openultrasast.push.eligibility import create_decision +from openultrasast.push.policy import CapabilityAdmission, CapabilityKey +from openultrasast.push.runner import _provenance + + +def main() -> int: + parser = argparse.ArgumentParser(description=__doc__) + parser.add_argument("--evidence", type=Path, required=True) + parser.add_argument("--runtime", type=Path, required=True) + parser.add_argument("--out", type=Path, required=True) + parser.add_argument("--declarations", type=Path) + args = parser.parse_args() + + def read(name): + return json.loads((args.evidence / name).read_bytes()) + + profile, validation, run = read("profile.json"), read("input-validation.json"), read("run.json") + current = _provenance(args.evidence, ScanBudget(max_model_calls=0, max_regions=500, order_by_evidence=True)) + if args.declarations: + declarations = tuple(CapabilityAdmission.from_payload(d) for d in json.loads(args.declarations.read_bytes())) + else: + declarations = [] + for capability in sorted({c["capability"] for c in profile["cases"]}): + language, framework, family = capability.split("/") + key = CapabilityKey( + language, + "unspecified", + framework, + family, + "dominance" if family == "access_control" else "taint", + "unreviewed", + current["semantics"], + ) + declarations.append( + CapabilityAdmission( + key, + "unqualified-population-v1", + str(args.evidence / "scorecard.json"), + "experimental", + "Unreviewed consequence for {operation} in {context}.", + "Unreviewed repair for {operation} in {context}.", + ) + ) + decision = create_decision( + profile, validation, run, current=current, runtime=json.loads(args.runtime.read_bytes()), declarations=declarations + ) + args.out.parent.mkdir(parents=True, exist_ok=True) + with args.out.open("x") as stream: + json.dump(decision, stream, indent=2, allow_nan=False) + stream.write("\n") + print( + json.dumps( + { + "verdict": decision["verdict"], + "enabled": sum(e["declaration"]["enabled"] for e in decision["entries"]), + "artifact_sha256": decision["artifact_sha256"], + } + ) + ) + return 0 if decision["verdict"] == "PASS" else 1 + + +if __name__ == "__main__": + raise SystemExit(main()) diff --git a/src/openultrasast/push/eligibility.json b/src/openultrasast/push/eligibility.json new file mode 100644 index 0000000..48e84b6 --- /dev/null +++ b/src/openultrasast/push/eligibility.json @@ -0,0 +1,3388 @@ +{ + "schema_version": 1, + "bindings": { + "core": "36ac9a045b8b8ad943eea1f511924caae54750a9d5d45da776ebefc460f08eab", + "engine": "joern-4.0.625", + "engine_runtime": "2b415139532d8d3a0c6e46ecdac26cd3d792efc2bae441f0b7e39bb28ec5d16e", + "facts": "32edb6e1a78f1afb08ac4248cd436be16663e0d90dc1b3aaf948f2ce49a5a8f0", + "queries": "7bf090e053331f03d04c9290c8a593d00efd4d390f4b77b8382c2befc47996cc", + "policy": "6fc8e3cf0d3a4f45dd882e37a753e34bc0cd187295cfbd3cbb6fc36ecf9cea20", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "verdict": "NO-GO", + "entries": [ + { + "declaration": { + "key": { + "language": "c", + "runtime": "unspecified", + "framework": "libpng", + "family": "memory_safety", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "paired_positive_fixed_benign_population_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched", + "unresolved_input_or_unsupported_population" + ] + }, + { + "declaration": { + "key": { + "language": "javascript", + "runtime": "unspecified", + "framework": "express", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ], + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 1308, + "value": 0.0, + "wilson95": [ + 0.0, + 0.002928295027470378 + ], + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 3, + "p50": 30.56611180899199, + "p95": 30.606516609084792 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 3 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched" + ] + }, + { + "declaration": { + "key": { + "language": "javascript", + "runtime": "unspecified", + "framework": "express", + "family": "unreviewed", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 1, + "timeouts": 0 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "paired_positive_fixed_benign_population_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched", + "unresolved_input_or_unsupported_population" + ] + }, + { + "declaration": { + "key": { + "language": "php", + "runtime": "unspecified", + "framework": "wordpress", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "benign_interruption": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ], + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 3, + "value": 0.0, + "wilson95": [ + 5.551115123125783e-17, + 0.5614970317550454 + ] + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 1, + "value": 0.0, + "wilson95": [ + 0.0, + 0.7934506856227626 + ] + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 3, + "p50": 30.645914101973176, + "p95": 30.678011666052043 + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 3, + "timeouts": 3 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched" + ] + }, + { + "declaration": { + "key": { + "language": "python", + "runtime": "unspecified", + "framework": "flask", + "family": "access_control", + "mechanism": "dominance", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 0, + "timeouts": 0 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "paired_positive_fixed_benign_population_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched" + ] + }, + { + "declaration": { + "key": { + "language": "python", + "runtime": "unspecified", + "framework": "flask", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "NO-GO", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + "metrics": { + "recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "precision": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "fixed_side_silence": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "benign_interruption": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unobserved": 0 + }, + "completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "regression_detection": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "actionable_recall": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null + }, + "query_completion": { + "numerator": 0, + "denominator": 0, + "value": null, + "wilson95": null, + "unmeasured_cases": 0 + }, + "latency": { + "cold": { + "samples": 0, + "p50": null, + "p95": null + }, + "warm_changed": { + "samples": 0, + "p50": null, + "p95": null + }, + "identical_tip": { + "samples": 0, + "p50": null, + "p95": null + } + }, + "unresolved": 0, + "timeouts": 0 + }, + "reasons": [ + "actionable_recall_gate_failed", + "completion_gate_failed", + "fixed_or_benign_gate_failed", + "independent_warm_latency_missing_or_failed", + "independent_workload_missing", + "paired_positive_fixed_benign_population_missing", + "positive_controls_or_reviewed_alerts_missing", + "precision_gate_failed", + "query_completion_gate_failed", + "runtime_gate_or_provenance_failed", + "semantic_scope_unreviewed_or_mismatched" + ] + } + ], + "inputs": { + "profile": { + "schema_version": 1, + "manifest_sha256": "eec13cb19fe5e2c2402e61ebf4fd17fa809482f321e7a8e615215a12e1bcf845", + "cases": [ + { + "id": "pmpro-introduce", + "base": "pmpro-fixed", + "tip": "pmpro-vulnerable", + "label": "vulnerable", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [] + }, + { + "id": "pmpro-repair", + "base": "pmpro-vulnerable", + "tip": "pmpro-fixed", + "label": "fixed", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "PMPro upstream2.9.7 to2.9.8 parameter binding fix for CVE-2023-23488.", + "prerequisites": [] + }, + { + "id": "pmpro-benign", + "base": "pmpro-vulnerable", + "tip": "pmpro-benign", + "label": "benign", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [] + }, + { + "id": "nodegoat-introduce", + "base": "nodegoat-fixed", + "tip": "nodegoat-vulnerable", + "label": "vulnerable", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [] + }, + { + "id": "nodegoat-repair", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-fixed", + "label": "fixed", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replacement of three eval calls with Number conversion; source tutorial also documents alternate numeric parsing.", + "prerequisites": [] + }, + { + "id": "nodegoat-benign", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-benign", + "label": "benign", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [] + }, + { + "id": "VAmPI-SQLI", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/injection", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ] + }, + { + "id": "VAmPI-BOLA", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ] + }, + { + "id": "VAmPI-BOLA-BOOKS", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ] + }, + { + "id": "libpng-CVE-2025-66293", + "base": "libpng-envelope", + "tip": "libpng-envelope", + "label": "unsupported", + "role": "envelope", + "capability": "c/libpng/memory_safety", + "provenance": "Arithmetic/bounds is outside the current abstract domain; measures graph/cost envelope only.", + "prerequisites": [] + }, + { + "id": "ghost-reserved-population", + "base": "ghost-reserved", + "tip": "ghost-reserved", + "label": "unreviewed", + "role": "reserved_holdout", + "capability": "javascript/express/unreviewed", + "provenance": "Reserved from production API/module/async shape and public security-fix history before scanner results. Manifest6.64.0-rc.0, Express4.22.2. Not an ESM or Express5 coverage claim.", + "prerequisites": [ + "Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.", + "Freeze core and existing facts after development; preserve reservation and record any contamination." + ] + } + ], + "config": { + "ranking_mode": "evidence", + "engine": "joern-4.0.625", + "engine_runtime": "2b415139532d8d3a0c6e46ecdac26cd3d792efc2bae441f0b7e39bb28ec5d16e", + "facts": "32edb6e1a78f1afb08ac4248cd436be16663e0d90dc1b3aaf948f2ce49a5a8f0", + "queries": "7bf090e053331f03d04c9290c8a593d00efd4d390f4b77b8382c2befc47996cc", + "policy": "6fc8e3cf0d3a4f45dd882e37a753e34bc0cd187295cfbd3cbb6fc36ecf9cea20", + "core": "36ac9a045b8b8ad943eea1f511924caae54750a9d5d45da776ebefc460f08eab", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2", + "version": "qualification-replay-v1-development", + "scope": "full tracked tree; declared first-party graph/target exclusions; evidence ranker", + "hardware": "Linux-6.8.0-138-generic-x86_64-with-glibc2.39", + "budget_seconds": 30, + "targets": { + "pmpro-introduce": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 936 + ] + }, + "pmpro-repair": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 937 + ] + }, + "pmpro-benign": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 937 + ] + }, + "nodegoat-introduce": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "nodegoat-repair": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "nodegoat-benign": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "VAmPI-SQLI": { + "path": "models/user_model.py", + "function": "get_user", + "family": "injection", + "lines": [ + 73 + ] + }, + "VAmPI-BOLA": { + "path": "api_views/users.py", + "function": "update_password", + "family": "access_control", + "lines": [ + 187 + ] + }, + "VAmPI-BOLA-BOOKS": { + "path": "api_views/books.py", + "function": "get_by_title", + "family": "access_control", + "lines": [ + 51 + ] + } + } + }, + "gates": { + "precision": 0.95, + "recall": 0.9, + "completion": 0.95, + "warm_p95_seconds": 30.0, + "fixed_false_alerts": 0, + "benign_false_alerts": 0 + }, + "profile_sha256": "5afd697cdd378917d08d84f51f3657e71013ec90ffb17804ab661e9df951bea2" + }, + "validation": { + "schema_version": 1, + "manifest_sha256": "eec13cb19fe5e2c2402e61ebf4fd17fa809482f321e7a8e615215a12e1bcf845", + "population": 11, + "capability_prerequisites": { + "php/wordpress/injection": [ + "Independent untouched PHP/WordPress vulnerable/fixed/benign population missing." + ], + "python/flask/injection": [ + "Independent untouched Python/Flask paired changes missing." + ], + "python/flask/access_control": [ + "Independent untouched Python/Flask paired changes missing." + ], + "javascript/express/injection": [ + "Ghost supported-family pair review missing; NodeGoat is inspected teaching data." + ], + "c/libpng/memory_safety": [ + "Unsupported abstract domain; envelope cannot earn detection admission." + ] + }, + "snapshots": [ + { + "id": "pmpro-vulnerable", + "status": "ready", + "bytes_read": 93181, + "files": [ + { + "path": "license.txt", + "size": 1039, + "sha256": "98424ae7dd8610cd5e3a29dd2775347552444e4793653823bc74c010d39265ff" + }, + { + "path": "classes/class.memberorder.php", + "size": 55918, + "sha256": "3d32b8414eb9a6bfe8962aafa8ab2caf826d2816811caf51d299db3398f54c26" + }, + { + "path": "includes/rest-api.php", + "size": 36224, + "sha256": "f52c146967d1d154b65dc5fb289ee831a7a0d31d7a9bba4876f40eee903624b0" + } + ], + "commit": "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "repository": "https://github.com/strangerstudios/paid-memberships-pro.git", + "license": "GPL-2.0" + }, + { + "id": "pmpro-fixed", + "status": "ready", + "bytes_read": 93465, + "files": [ + { + "path": "license.txt", + "size": 1039, + "sha256": "98424ae7dd8610cd5e3a29dd2775347552444e4793653823bc74c010d39265ff" + }, + { + "path": "classes/class.memberorder.php", + "size": 56202, + "sha256": "6877bdc6f9322fe990be8aedfd1778718fc3e06b67c96eff47be16824eb9b312" + }, + { + "path": "includes/rest-api.php", + "size": 36224, + "sha256": "f52c146967d1d154b65dc5fb289ee831a7a0d31d7a9bba4876f40eee903624b0" + } + ], + "commit": "2f65530f9442b4d7ccfb56821836b056217358c1", + "repository": "https://github.com/strangerstudios/paid-memberships-pro.git", + "license": "GPL-2.0" + }, + { + "id": "pmpro-benign", + "status": "ready", + "bytes_read": 93181, + "files": [ + { + "path": "license.txt", + "size": 1039, + "sha256": "98424ae7dd8610cd5e3a29dd2775347552444e4793653823bc74c010d39265ff" + }, + { + "path": "classes/class.memberorder.php", + "size": 55962, + "sha256": "457cfa61eddb5d339502143ab59fd93db93d577a1557f6552081c6a6fc2ebf8b" + }, + { + "path": "includes/rest-api.php", + "size": 36224, + "sha256": "f52c146967d1d154b65dc5fb289ee831a7a0d31d7a9bba4876f40eee903624b0" + } + ], + "commit": "1a900be3f09f243876150fc3c04a97bcb24ef84b", + "repository": "https://github.com/strangerstudios/paid-memberships-pro.git", + "license": "GPL-2.0" + }, + { + "id": "nodegoat-vulnerable", + "status": "ready", + "bytes_read": 20677, + "files": [ + { + "path": "LICENSE", + "size": 10273, + "sha256": "73ba74dfaa520b49a401b5d21459a8523a146f3b7518a833eea5efa85130bf68" + }, + { + "path": "package.json", + "size": 1979, + "sha256": "138377cf0f19b955d6ba043e49c24fb5eec4041a789fea5134e1fecda620c829" + }, + { + "path": "app/routes/index.js", + "size": 3149, + "sha256": "3ab970b2888bc1501515db24a83cc7851ac9c09d00948c652300401515185eb5" + }, + { + "path": "app/routes/contributions.js", + "size": 2485, + "sha256": "196bdeaa22da4cfe8a851b1b932710b2fcedd21f14ed75d70b739ba759a01003" + }, + { + "path": "app/data/contributions-dao.js", + "size": 2791, + "sha256": "363065e8b3c32f0997ce2dcb17341eb3e40b7f43b00b72c576dfebf73f551c85" + } + ], + "commit": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "repository": "https://github.com/OWASP/NodeGoat.git", + "license": "Apache-2.0" + }, + { + "id": "nodegoat-fixed", + "status": "ready", + "bytes_read": 20677, + "files": [ + { + "path": "LICENSE", + "size": 10273, + "sha256": "73ba74dfaa520b49a401b5d21459a8523a146f3b7518a833eea5efa85130bf68" + }, + { + "path": "package.json", + "size": 1979, + "sha256": "138377cf0f19b955d6ba043e49c24fb5eec4041a789fea5134e1fecda620c829" + }, + { + "path": "app/routes/index.js", + "size": 3149, + "sha256": "3ab970b2888bc1501515db24a83cc7851ac9c09d00948c652300401515185eb5" + }, + { + "path": "app/routes/contributions.js", + "size": 2491, + "sha256": "9dc0a0bc147adc4c76c27faae75f316dd537ddaf4fb35fa693002450bd4b4e92" + }, + { + "path": "app/data/contributions-dao.js", + "size": 2791, + "sha256": "363065e8b3c32f0997ce2dcb17341eb3e40b7f43b00b72c576dfebf73f551c85" + } + ], + "commit": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "repository": "https://github.com/OWASP/NodeGoat.git", + "license": "Apache-2.0" + }, + { + "id": "nodegoat-benign", + "status": "ready", + "bytes_read": 20677, + "files": [ + { + "path": "LICENSE", + "size": 10273, + "sha256": "73ba74dfaa520b49a401b5d21459a8523a146f3b7518a833eea5efa85130bf68" + }, + { + "path": "package.json", + "size": 1979, + "sha256": "138377cf0f19b955d6ba043e49c24fb5eec4041a789fea5134e1fecda620c829" + }, + { + "path": "app/routes/index.js", + "size": 3149, + "sha256": "3ab970b2888bc1501515db24a83cc7851ac9c09d00948c652300401515185eb5" + }, + { + "path": "app/routes/contributions.js", + "size": 2498, + "sha256": "66b97183be80e55fa3d690d2fc7103aabddb4e10ef9db439c22bce6c7651bcc4" + }, + { + "path": "app/data/contributions-dao.js", + "size": 2791, + "sha256": "363065e8b3c32f0997ce2dcb17341eb3e40b7f43b00b72c576dfebf73f551c85" + } + ], + "commit": "c5cb68a7084e4ae7dcc60e6a98768720a81841e8", + "repository": "https://github.com/OWASP/NodeGoat.git", + "license": "Apache-2.0" + }, + { + "id": "vampi-regression", + "status": "ready", + "bytes_read": 17541, + "files": [ + { + "path": "LICENSE", + "size": 1063, + "sha256": "e3e05b9d17e397de650aa7a9a9784cf076ba8bf566efebe88a0e24ecb2d2b92a" + }, + { + "path": "models/user_model.py", + "size": 3642, + "sha256": "4ce47b9850812e47140b2d2f2e20c08ae4b5338d168ce72f23e3127986ef6e1b" + }, + { + "path": "api_views/users.py", + "size": 9257, + "sha256": "46006eb7207ebbae163f5320b13e3bf0ec464cef201a51fb2cd43b5cfdb4116c" + }, + { + "path": "api_views/books.py", + "size": 3043, + "sha256": "78e2eb77d655573f03b7a4d0bca73dc27383b0c5ec7882a5aa8608caa52828e8" + }, + { + "path": "app.py", + "size": 536, + "sha256": "ad26b12cfbdaab311bea86942f5ebd368dca331a0f4cdba803393739baadf42e" + } + ], + "commit": "f16052dce83f05847133ec98f01c5193a41de7d8", + "repository": "https://github.com/erev0s/VAmPI.git", + "license": "MIT" + }, + { + "id": "libpng-envelope", + "status": "ready", + "bytes_read": 147103, + "files": [ + { + "path": "LICENSE", + "size": 5345, + "sha256": "16d9daaafbf63a31a5bdc91d4600972548fef5aaa1244202393288dbd079c49a" + }, + { + "path": "pngread.c", + "size": 141758, + "sha256": "c12022962f04abe1f7156753315bf68091398711025450803d0506dcefda3552" + } + ], + "commit": "cf53e54ccf631d8de68a30ebb3b8eeed1d6f1a08", + "repository": "https://github.com/glennrp/libpng.git", + "license": "libpng-2.0" + }, + { + "id": "ghost-reserved", + "status": "missing_prerequisite", + "bytes_read": 0, + "files": [], + "problem": "ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it" + } + ], + "cases": [ + { + "id": "pmpro-introduce", + "base": "pmpro-fixed", + "tip": "pmpro-vulnerable", + "label": "vulnerable", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "pmpro-repair", + "base": "pmpro-vulnerable", + "tip": "pmpro-fixed", + "label": "fixed", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "PMPro upstream2.9.7 to2.9.8 parameter binding fix for CVE-2023-23488.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "pmpro-benign", + "base": "pmpro-vulnerable", + "tip": "pmpro-benign", + "label": "benign", + "role": "development", + "capability": "php/wordpress/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "nodegoat-introduce", + "base": "nodegoat-fixed", + "tip": "nodegoat-vulnerable", + "label": "vulnerable", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replay direction reintroducing the reviewed operation; not a claim about the historical introducing commit.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "nodegoat-repair", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-fixed", + "label": "fixed", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored replacement of three eval calls with Number conversion; source tutorial also documents alternate numeric parsing.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "nodegoat-benign", + "base": "nodegoat-vulnerable", + "tip": "nodegoat-benign", + "label": "benign", + "role": "transfer", + "capability": "javascript/express/injection", + "provenance": "Authored comment-only change: no new defect; vulnerable backlog remains. This label does not mean repository-clean.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "VAmPI-SQLI", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/injection", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "status": "missing_prerequisite", + "admission": "experimental", + "problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "status": "missing_prerequisite", + "admission": "experimental", + "problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "VAmPI-BOLA-BOOKS", + "base": "vampi-regression", + "tip": "vampi-regression", + "label": "regression", + "role": "regression", + "capability": "python/flask/access_control", + "provenance": "Existing recipe known target, full target population retained; environment vulnerable=1. Snapshot regression, not an introducing push.", + "prerequisites": [ + "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + ], + "status": "missing_prerequisite", + "admission": "experimental", + "problem": "Reviewed independent vulnerable/fixed/benign push pair required before hook admission." + }, + { + "id": "libpng-CVE-2025-66293", + "base": "libpng-envelope", + "tip": "libpng-envelope", + "label": "unsupported", + "role": "envelope", + "capability": "c/libpng/memory_safety", + "provenance": "Arithmetic/bounds is outside the current abstract domain; measures graph/cost envelope only.", + "prerequisites": [], + "status": "ready", + "admission": "experimental" + }, + { + "id": "ghost-reserved-population", + "base": "ghost-reserved", + "tip": "ghost-reserved", + "label": "unreviewed", + "role": "reserved_holdout", + "capability": "javascript/express/unreviewed", + "provenance": "Reserved from production API/module/async shape and public security-fix history before scanner results. Manifest6.64.0-rc.0, Express4.22.2. Not an ESM or Express5 coverage claim.", + "prerequisites": [ + "Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.", + "Freeze core and existing facts after development; preserve reservation and record any contamination." + ], + "status": "missing_prerequisite", + "admission": "experimental", + "problem": "ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; ghost-reserved: pinned checkout 07671c072c5a5e0538cbe44d9d4ca66111751535 unavailable; rerun this validator with --fetch to fetch it; Review and freeze supported positive/fixed/benign changes from independent history; select family before scanning.; Freeze core and existing facts after development; preserve reservation and record any contamination." + } + ], + "note": "Input validation only; every capability remains experimental pending independent evaluation." + }, + "run": { + "profile_sha256": "5afd697cdd378917d08d84f51f3657e71013ec90ffb17804ab661e9df951bea2", + "context": { + "ranking_mode": "evidence", + "engine": "joern-4.0.625", + "engine_runtime": "2b415139532d8d3a0c6e46ecdac26cd3d792efc2bae441f0b7e39bb28ec5d16e", + "facts": "32edb6e1a78f1afb08ac4248cd436be16663e0d90dc1b3aaf948f2ce49a5a8f0", + "queries": "7bf090e053331f03d04c9290c8a593d00efd4d390f4b77b8382c2befc47996cc", + "policy": "6fc8e3cf0d3a4f45dd882e37a753e34bc0cd187295cfbd3cbb6fc36ecf9cea20", + "core": "36ac9a045b8b8ad943eea1f511924caae54750a9d5d45da776ebefc460f08eab", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2", + "version": "qualification-replay-v1-development", + "scope": "full tracked tree; declared first-party graph/target exclusions; evidence ranker", + "hardware": "Linux-6.8.0-138-generic-x86_64-with-glibc2.39", + "budget_seconds": 30, + "targets": { + "pmpro-introduce": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 936 + ] + }, + "pmpro-repair": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 937 + ] + }, + "pmpro-benign": { + "path": "classes/class.memberorder.php", + "function": "getMemberOrderByCode", + "family": "injection", + "lines": [ + 937 + ] + }, + "nodegoat-introduce": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "nodegoat-repair": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "nodegoat-benign": { + "path": "app/routes/contributions.js", + "function": "handleContributionsUpdate", + "family": "injection", + "lines": [ + 32, + 33, + 34 + ] + }, + "VAmPI-SQLI": { + "path": "models/user_model.py", + "function": "get_user", + "family": "injection", + "lines": [ + 73 + ] + }, + "VAmPI-BOLA": { + "path": "api_views/users.py", + "function": "update_password", + "family": "access_control", + "lines": [ + 187 + ] + }, + "VAmPI-BOLA-BOOKS": { + "path": "api_views/books.py", + "function": "get_by_title", + "family": "access_control", + "lines": [ + 51 + ] + } + } + }, + "records": [ + { + "case_id": "pmpro-introduce", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.678011666052043, + "build": 0, + "query": 0 + } + }, + { + "case_id": "pmpro-repair", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.63855000003241, + "build": 0, + "query": 0 + } + }, + { + "case_id": "pmpro-benign", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.645914101973176, + "build": 0, + "query": 0 + } + }, + { + "case_id": "nodegoat-introduce", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [ + "590ded4d9ba52b59e2934f3d461e45dfa5bd351f13c4fc17238297438fbf492f", + "33ab14574877d6a529a58df1926e358759fb4ee1ffbc68146aebf77a895c8eb9", + "489bf9f5f3a1e3771698cf111c0e7fa3e84f81848869c88a44cf3d19979d168c", + "ca3b943eb07fc11f6cc16228ae4e7813cfccac5dfe7ea9147deb0ce84677e486", + "a83d9fd2d4f399a40984cdc63e30003a73c98a6986f76fd5e22ed0ed7873c8b3", + "593c9114695f69035b4df9d566534e35fcfaa2d78a3e4362c2ff634580d6bee9", + "87ba1a35a429f850990db0eceda9996daf572b97b32b38e0f7ff4b80dec9a6b2", + "e9cf95baf8cef9a83d9da86e0bce276421ed404867ad948acc338fa759a3450a", + "431521d90fc22b7683173732598c39b94a25447f7403dcd4d9e17ca23e243a61", + "d331868f74b26a35872e8eeed4f66f3e34a29f8e9745fc14c1609cc3408aebeb", + "61b6ec72d6c0dddae427635aca3c97681a112cc4c5f8e4367d9f5864c6eb72b3", + "e831bbc3ab250e71270b1f5175756f39c2da662bffd68b2ed78b5389a4f23d0c", + "082910c464337b0041733c3c2733ad7947d71549180f9a0b8ad4172901469d02", + "14541cd08e0b036e4ab5caa442c01459fb03a6e3ef0388bcd0347b121effc6fc", + "da4abcaa22e13947dca90ac9156293bda9297423304d60d587569389742ce17a", + "29000feef9d494e003efdcbb6eab5410bc93ad2f4674df9db389ed98a9cfb242", + "4679cce5fa8da06bd1f9542b5a58321d2b090556cce83080b6e9ace36d352a59", + "df4a0610953efc25e4ddc4bc942688434be889411d073fab09015aba97ce2511", + "9b7910f9f96aa714b760481e46e543ea413d6e4763b858a3d0c186a560ad618c", + "298f3d69ca3e2b343c9cc5288680120b89e035bfae803dc6f6952358b6d0f1d3", + "7fbdc1e100a0b9078b6a2d6264bfaa596c64501b8c5ced1557b56a3d98e2b351", + "e4fe7eb3e5d57766a2c6adc79d46b9f57ac13ba11df7846cc4f7d62123a51bd4", + "0cc9059de118ef8da2ab45a3453bb2f64a679dfa33233f3b1b722b3858df789b", + "d561ce2e09d49013cacec011cf5dfa8c5f35c25c41085e856b3d5f28579ba6f4", + "7eb45f19bf15a2826d7aac45f36137de8824abfa9c0d5412da3c69c5d6da7a0d", + "ef130caaa2b3321cd12e2c8c39a27f9a868d2405e572fcafa5cab93900d9f97a", + "115b829e9b03431b06c12212efdcc2da02b5e22953e8a02243a8cd5a59cea0f4", + "db0e20f3ffa3b74105bddd565ba608daaea4cf9baba6b43a2539958e1a8be668", + "d2034c51a6d44b7b5cb553f2ad130441532b6be68cac0e829b74c4240aa642c4", + "1d7abc4a4a8c6023e1c5231f46167efdb6c476e4533ea4670a17ecc6c8d09c92", + "ba984e9deee4ab97a4211ce15915bc36e0e42907e21f40525be95c698c439653", + "ecc80bd3363347eac23b60a8ec50efe1a5defd3609aff7149022fac1e74524d4", + "7cead756038bdaf46936671d2311c93b391692337189bd9f3acb5711dcd1b594", + "d7044d436bcc3e7e313fb2baff364c8aecf980b28741afd4d020f858a47a3909", + "f0fb49041bdc02002b8aaf574a29a738aeb235ca0bc5cbbe9998dd9841e93a0d", + "f12e400682d1a222abca9d05f942a24394d7795eacc7ec322c585a0a6ffe69ec", + "5e24ba3194915f95a2452882fe928f834ed4740f8fa2087c7573b7c2f128a2ad", + "4d7554903c7ff3f7005fe4ed77f7e82af8cba218d3ac0b431acf14d18ffeb639", + "896720a23ec5b7da3163d53b517817cb01337cdad64d2104dbfdd3b3526f9c5f", + "e13de3ef10e25c529870483b67e47206b9cd32251e118f20f628eba95236d9c9", + "ac5ad3cda567527eb97dca35bb56d076292b88e20baa36d337967eb1f4f63dff", + "7c0bba65b77fc890e479add54e7fb0e9a7d145a4304d81f614536a8470d0a471", + "4ed8fe95db377770a47a2b3ad04a3a720ec21bdbd5222272ec5555130a627fbb", + "ece73e32fe91c87a001f1e41342e09378041ee876c8a8846a51347b8b607cc2f", + "8146eab0359ca0b822353b632ced69bf09fd449704cdf7c6f84440d7ca784cef", + "ec7c01083f1fcb35c35244172a005b3eabebff9c0fd1dcfb4372268f82fb3894", + "ca89f1fd26f88f845f394fce84527e83c6a4cc8252f30d6787e7c5ac13e119a9", + "c3b4d527dc5c4ed121a487d5e4e3aa868df773ef3b04200802f9a306bf67c730", + "9e5735029a42e23af56c2cc802655bf46c55bfebf19f19810ac16cfa15fc688c", + "a562474ca19fd4d4ec052396b656b092e82be7b1c002746f631cd9fb68b39ff3", + "22e26415a3768b1b12cfb9469b912d359d0804761ee7f1d02d281600373dc8a4", + "03548d772fd2a4030a9f595257333eb9b323f1057a2a0399ed15efea113e719d", + "0f5f635e19864fbd276fd3eb0b6460f86274e6bc52533594879fcc42c02e4df5", + "f95e55b8ae987f7c4b11837ddaa8dac8bed46541f6d8c12633b46fe915b41824", + "e77b04a213011bc3e9812f81c2d1266be1234ff91a72d347b71017e8ea09f4e4", + "f7ab6f0b570873d6b99c3fc33ab556f093d7f5e4991eac884d3e766a2c29b326", + "722bfc188cadc50c1485cf4ede13f2b62e93b08b16f42f2586c104b8bd3745e7", + "144c1db7c40aa0a420e02130a756c7793fc8fa5d33549a08c236ddb96bad2df3", + "6bb3ba6475ce8d11ff20924b69721387bb0d4bbce1b852e640403dbd750f0a8f", + "a08e3f98d65d0452a631a11de0ef53c9fb53492efcf3d8003b5512478b92b4bc", + "4e0e78390504d44716e20ff65cf5f16c1f1ddc2fa0441e503dcae1826c666529", + "0e143029eb9d5d5c30c3dc0fda147c852e68d4e8d407795a1047beb586723238", + "43e8934e37c9ecda6c36b4bee6af63f4269e59cefb5df30af45ae08bd93f5063", + "6ad6e59fa1a92132e095463bdbb461598c80b45af85ff453a6450b59b61d10cc", + "c2b3c06e92fa87731137f871b9dd0f867fc53156a80bbf00da955cf5bfe0fe7e", + "b7b9b9cb1194740a47fa214266a43fdb70019fa1308009589d38f2c7662aa4b3", + "4d3ed9000a9b5806a0ed641e2739166e3df18ffa1925ee396fbe25d29e332c71", + "bce9e3fb76d6276772f1f279260ddb2f673a4a45a08f13fbc75343d20c0ad4ad", + "f0aa35455461c8f75dd8ca533e03dd43ea339a7026f07407ef26b12c3fe6f44a", + "64c0f7e52fb34476d5e47478ff354845a776dd781a2044963cae3191bb18058b", + "9f9eb159649a2e07879e36c4f5eb5bbb38e337540c4b295adb4b59ca31e2a868", + "bfba8296d9252a696a7f8262a80b63019fd89fb866e3d3daab087101c9d7ebd2", + "6b6bc1f8b05dab47833d180de1fc7b40d8637a213c87af02f19bfac2f9439869", + "72261efc87c3f66bd420e106d6e04235b2d6a7b4c59ceb5a235dbfbf31d02f29", + "94e30a15524e236d04ae2f0238a72c0b446a48b7b4302471ad6703861948025a", + "fa59397c0eb909b5b269278b706ba8432004d786cc8431db1e27fdf9614211bf", + "a65d452c03e7a0e7bfc77d9337f0c3f6cc47449979963ca1173f45c619b7b812", + "135f8cdcca313308bc5456466706c561652768149ff61e93f241b383c07448e8", + "d029880ad27458bf1d443088b6afe399af206a9f412fd8406769198f304e64f5", + "2ae591e30078f1e045b446004067a4734acda37a9673dbac82bca972cb5f8c2b", + "b35cc9123b9c6316f72cdbfcd7945157215622625141e56543a4093c0c553013", + "c8d88ff3a98aaa4eba3756a5f0b89cdeeeda10e5180f5eee0d3ae2b7dd042cdb", + "f06f0c86aa4079e5d3ac48ffa9b50661a0bd2f4c315190b26f13664de494c9d9", + "627afe91ac03ff52d178f64eb23d372523f86fb34fcc0ca0dade6786c38f0dbc", + "ccab701536e7f9615e52f4b1a1c68a2416263ad8de279372ce248fed5d7868ed", + "bb71e211e99f3dbe040a15b22eb7e004da953ca61b700ca3d1c94764cb6bb80f", + "d799a15d3d810c39c4a519c59843bbb6c2617f559f8ebdefe801296e0819149a", + "d6a24a60b3cec846b01cb2c3a1535ee2ab834a09e935abe70ede278ecb1ef045", + "d1cae428bb382d9cc38acac1c7bb8a5e6142a46f5b0e6e2ddb1609b0acc66f68", + "c46c90f66921363f974dcf82aaf3b3410222ec081abe097417dd1a1accb372b4", + "5630ea72ee47272cdf5f9e3d1df3aeb499c357880ad49b26cff1cebcbbaaaeed", + "013a84070826e011c0b19953b3493276e98498b3837618303aff28475b38eb2c", + "c158a154e2b9394ee661d2f982e93af8d59543bb7da5c8d2c8e9c65905384d4a", + "a0423c87fb8581f1897c9a0c774c3881ba8775e05f6cd88408cee05d126ac52a", + "7e9c5dc7bc705ee6825fcebe23ba885a4be30b318195ec89e9a19b450bff86fb", + "c6c5a131a84fabe329dc50128240b463b18a4ea0af2d036bcc02d869ec57fa7b", + "ffe9fe5d19fd7233e88869bdd2f6fe00785a9b15d074a3f8b171a03121ba64b0", + "324cdf414ea58e6d9496c28b138b43bb18cd6e983fb7678aef960670a51dc93c", + "fb3bd242d8f9801589ca53c24a1b36b88ee1e6b8932ddb6a5d3bb7b3019556be", + "5784aa43502be5cfa00e65ed1800bc86cea1b83db7b99737a92e3059c0aedb51", + "e05d1e4da035294fb1b5185492276e323b43a33c173dd05390edee2726f82f60", + "480a6f9e635cdb839e9ed2fab13d22291dff3c92ae99e1bf514439b370480f24", + "acc5d491964faf3f4858dce3bfe338199f9b5469c1ad33e64c2f0bfad2f0263e", + "e14724d931f179f9298c723043307a99153207ec425d4fae28f78becba7c0a9f", + "756d4aea97736b83d6904a6d96d22e8026d24796d64d6806c2fcc478272c16bc", + "8fc292a32ac35211b4747151ed7797cdcc9cf7edca0ea697f9cd9ca9eb2bf906", + "0434560a038fb3a29aaeae6531b7190a9a993f75cebecbde4dbc5d9f248c16b9", + "5c7e3540a665e15247dc85c88bc06f2514da2cd85010ec820cc53548ac751009", + "074e2d12c8900202ecd6b02df395375ee6343d1c04c22982c214e74d38fdf51f", + "cf2f20c22b8acc270d75b060b45b3725d2a4a0bc4dc33adc9feeec336fa84f31", + "bb67a42d62cb5389aeb41a0e18d26046ab4f20feae70cba114ddffd5995ac3e8", + "ad9733cd531deb592afd4650ebd20d8c967ea49693d2954151a70f4a4edb68df", + "572f510d0485395c2ff610cd031d238c3745f79fe98a8f9fef5b042c24e57b69", + "0ae9ac017e10c4d6256d41b99b5e771d7e8acf05bc1087acb58148a8ea2e8c5b", + "691315c9798b266ce8aaff0a6368a80e40c685c1a8e3a54fe139131f4d6da7a7", + "aee4c8330dd8ef28010fdaf243964d48dec427871626422da8d915843534755b", + "57aa82c0185ff3d73d91dfcbc6bae9b5d438cf064ed0ea9489d6b5de7c3df531", + "79ed0c8a9f7d6b06e75ef023d6ca5a32416a9c8fbd5a75fd97ea1c0e8f7a5a30", + "23f9afb28b6b7349cbf502c2a6a1ffff117d2b3a974d8705b99fc8717108627b", + "a6f0fe4aec662565f32d93874690023ebe09aea9a887b330e0c64a18e41dc966", + "aa5a287a1749ab0ab4e4b56048c738b95df8f4b19a82378847a39ccb5eb42315", + "09dff44163511e71b0fbf539655ece1940bd80039bc8743cc922699a37340b71", + "567b6eaa4c3dabaccdfb44885a6a4cd345ce3ffc6a201265084c1818c0b84226", + "881e7f1a45e2d7ebf74842b131573da24478db0c44ddaea50ca20007994387c0", + "e9a98c513dc38db66988ce7ed9fe730df4ba5297f2495c77a54ad2aa9195b9e6", + "f7484f28717752c36583df6d2167f9861bbf8368ac7f18b8a7c41ed41f301f37", + "c0c4a04d19b7a5f1f33fff97f49a9d0245c4b14d24c3691cefbf46b76c064d7e", + "2b86fe6715dd628b59d2303d2939369a6ebff338e7c9a3f41a5e76371e70d56b", + "3663dbf64c23ffed29746c390953bb4c54f0f3154cc9fa65e7bf6acdf7249702", + "8beedef6ba5098ea3567e7e9dd3ff36fa7ccf418f7a8dabc5cd1c8df83ac946e", + "07ee5dd2f228e5d605f204a0e607fde140b169321c49486f64ef0ef3498defed", + "34ca592cc7c4769ab6ab180436ace3d801b26463a0915b253459fbe8aacc7ce3", + "2ee6a26bbed8f2554b909b310e8fbcafea825d9016c009fa785f34121053ae17", + "6dd70277e9e05c3828bec89c4cc94f2b256eef50554fe78b7bc7805ba0c77d7d", + "448a4023be7987eb4282a5534d6369f7e8ded7ddb3cc29c537a4e09ded04434a", + "338e654fb02855abf17360c328f02986bf949d898b489ea7b9b29ce090fd1eeb", + "bbd12c331fb019e0c84c5629c0b4945609328a196e3862f6f6dbadba31da81c9", + "06ea156efb68bae0ec77525ddbd4eb18c1c97512cf524cdd7661286b48a2684a", + "163b26e0bcc1ebc83d620624356e8a535ba4a3130af719e57a4dad9922d0ca1c", + "ef7c18370144ac600fa593af56a8a849f7070b91261415e8e3cad6bcdadc80da", + "f196cd68d51074be3989e323fc62287af695b781697b91b658003c825b426ce6", + "a763fb136aa3978b7f47acb90aae2c6bb5715e8ca5ef1088d7856608c8807071", + "5bdc9a08c76139479780eda09106fbec03bd5662c1817f14c0893abe4c22c798", + "4d34d526ba5ee10314a8f6a74f7fedddbcf0ca79986c20a5127dbb08acfd6c43", + "2c2899bd893f9611640844c56b404e5b91768151cb862ff497bb823c505d568a", + "be30cb63922297543ed6c72314d3b6ec3d849d3c5d28fc3590ad44ebd82c4f0e", + "28f1d0d25c8654cd762a439d6eb6f3a6896d37071f406d8edeeb4c20adee20ce", + "f6a81369acf1c84e3cd6bf3399289323cb47848984a8c96800c0682fc1055a04", + "94b9c4a91bfce96cbe773c203dfdf22d1b015231e91dd478399c2586be6a3e77", + "526ce466755c525287df1a2adbdbdf566c896d79150b9bc7dbe65936e83abb30", + "57dcaf9ddb9d8b054aa5dda6a0c9739439362e898cdf22aaf9f7338149f8cbd7", + "064ff0d84035d834f9382eb8b4ad901fbeb4aa9fe816d7c36a34d56af41817bd", + "d97343cdd389cd2ed9d0f1358d2bbddc2752053d95eab3e16e99423298a4371f", + "f9deb31f0f9b98cad69111389734d43ed4fa86f24b05c9f2d48a78ea7a8708a3", + "f962a89d04810a6c57abde4a8d3182d2a31c5d0f0ed3c37c053abea1fa223f31", + "b62ac1b4b282eadf241f508bd5769bdd440b274f967d6ca73cb685ca249bd287", + "57840b0da13c3f6f67e587689ab1eac913c17e91d493d1ce9ff089e8dccdfd29", + "e3d1ce3b9de0fc9b48f2432d5e64947b5b24c3acaf1166f746bff1c54a028b9b", + "d322db4b50c2c1bdbe0e22ef291070e20c93e0f7199c184f5ff8b4795b55cbe9", + "88371d1acc9bc3b69c1d1957b27c9aefa3835be37bba74a359c35b1beaddc2f7", + "3486da81fc55b7e285f23e85f44c481d780090285a384cfedaefa27265a236a8", + "c87588b38d18fe9a5c563e2ae8d79649ce699607a891bd41b68194ce4507137d", + "d6e3d356d491e5f3dbaca74cf11aef9bd751b36737feb34e466b707156b0d779", + "843197ad039bb4e840b949b0ed1e5cf2230829366646a92ffc53d63e26149867", + "b0766042c55d7c370799af987bed01fed8a417f83bc67e21d1366988aa1af10e", + "b788ba22bd4225c24f95821dbf1f467dc2b13c7615b0bd2b00c3b234b7519539", + "91430345496348280d29d11662aeb6048fd7596fc6304380b6154494df30d154", + "8c1be7b4e8fd13181be0c4e46350a2f972e24acd13427e71c15e60dade41c28d", + "f87a9ae1d7dc81f88c5891890b889aa7212e172ddec092182b7de6f01e787d7a", + "b6a42fb01b464f31f65ebc10fbc12fccb051d8b44cac51a6818d3aedabea07f9", + "4a820a780053b6f65492691e067e236adbd2a05b467e4e3f2ed37ba1260ce84f", + "b07131192ab22510055930477ced5a10698278b2e00e3f711ebc202db640bee4", + "5fbb00d9b2952ae4f0fed217bf2d8603872d8fc93073d99f31d8815539121987", + "0bd48e207e95be86ea4e459c090a75c0adac8ca31bd2b631043854551b2c4392", + "b11de5874aa62f939e383179c3ea1b34d3569ec6ade901964393b92f8325ad11", + "8cd692618bec00fbbf099d570561201a2d0fdb601050fd20e198ead478530675", + "19345b5fb5cecfc86e4db3cb8715cc7370e81796d70f11ba150a13c5ea8e4c37", + "3ad0b3549b82f93ad869a9341397d394c1acee5e18d94a699b118094dd7a9a70", + "32220b1bfe511b9dcec64d7ea8f4317e96b2d0cdc10bcfa55cfa3b63ce64aab6", + "0cca9d955282f37dd60e764c56b52cbad90b33ec2c2943a7e5d155d35b0417fa", + "40d00274aa5b28039b0d57d75a81f174c0a31e4be2d324ba79a64b79efd4e411", + "319d00690097314e26638e2f4a6d848f50d1ff2f9d6f755a618eb31398ed373a", + "dfa47fe83d195de69774c841747f6e7ea78d6d91297821dc9b8ee5fc625cfe2b", + "5a497ad4d83218c29d4f22781a54d9e1927dc414f7cba6f89d794ed047f8b245", + "1bd3f2289cc1bfa889496ca5074991941263703a2517281734f33d0ef1050f1a", + "587a689c0312ac0f6d98de7495f01f34428cb128e73875a71508f7d5874415b4", + "fc77f013f48b454d8703f25f76646f74b74c9e4f8e5d542bc5f48d98c6e51fae", + "a2a7af80da34233233ec619dc29366b40a9e55ead63626db185524f2415761f5", + "f180a77f032bfea9c7d152438ba830f19e1bfc88481a56b9e554c61d2cd64f6e", + "cb70e9a1b44fa1f13f3bcc5290e6db5c8d6eda83602c9513e91e779ac6cddd3f", + "74f543e29e519871aabcedb9d39c953d5397aac456c3c5e6eb0e10e517989eb3", + "c983c339bc6881a1e6a0b2c6a794de858613b91318205a623dc61d80c2238036", + "97c5314218bfb458e1fb6d1a33c9ac75c7de152774a736f6c5874657515ccfcb", + "0744dea5a54614d094a6eb711ff7df94a180bfdeacaf330e31d9466cd51aeda2", + "06dc1ba86d3fcb46096bed80d9c5c558f79a5a33f4fcdb379f1567b1271b64ab", + "aa48541c8cce586b7a8c5e8ebe3cb607d1c283ef8940b7d4c7fb584327dd177f", + "a9d086126128de76e0bafc06ca465176ed2884cb7ec963457fe106346b8094f9", + "637323a350346cee17c66cda9b8b1be49d58350b0a0904bd61e5af20ce611df5", + "aa25524f30b8e84ef80b52064a75ca56cf438e67e2696e360d683c03e85c4c6f", + "9b5371eadea2bf5707f730896b4766a8b56012269f1c02c5df9d0df1d1cbf696", + "d527de43dc2dfdb271c213a927ab31c08b1f063298b211b6b11831a4dff51922", + "5ee4f0b0ba2c39e7071bba12da912c1ae213b8a2cee0bb437afa500328a237d4", + "43d3388ae21433a62d37d4c92861c125683f03a0edd9d1afaa56a42a7b793dc1", + "cc8161804d4c84fe4c4f7210a16193637accc1f791b7fc7be026c07177b7da4c", + "4bc68b77bfd52e96e8db4fb7293a6d4f396d234eb4dafb625df76bc8f1ba1c7d", + "a66e57d86751f21d11652bc991ffe476eacb638f38f95947b723ac9448c5f668", + "278e2e9a97727da969f8d122576dd475c43141146f984e3af997600a013f19bf", + "3152613ac0763b809bc99a50b728391cfe19d2cfeb27ff47a1e3671ed7526a3f", + "06168cf4f7850405f47bd8cfe013dc077b51457b355698ea3407f998cb561c2b", + "44620fe943880d4498587b283cf31a67b85fdeef53f59223299018c3666ae32b", + "eaa4fc381ad8dd4a49b66bbe7ccb050b2ed8735ec0d5eaee4f555fce0ff39a8c", + "68a35789d8aa7b4f5293eb06988118bf39be4f0354e6dd89674da130c4ff7911", + "3c9cfda0c903ea8e97a9bdc2966dff555df6580479782ced9ea934837e3bdb5c", + "4367699c5a75ef7a22a52ca8d1b77e15ae6c8c18b2ec5fa929d688281ff34edb", + "f020689fd3ee8e3f51d12f177d80fb80aba8d3435a9f58e63cf4caadc02eca10", + "06f7107e12e2f2c7151d2c38ca31adcd8690e7dcab4537b37183561a9306208c", + "2f8516c90c01cfb4bd29a3b8ad1b61280436a37804b24929327cb41d8eac39aa", + "8f51fe6438299d6f935f48d1d0991270ad477174195aff8574ef587a45038efb", + "8d26ec62881cf7efa89509047c178e7b920a87cc4bfb9cb0d6d991e87ca22124", + "ec5cd96c01771e651d9e09445c5df8af453e475da75f47a583a1006e99686b09", + "2981a228c15eb8a02d051bad6ce39736dd5f4c3f63a979d997bc23086105cbaa", + "7055c8f3c6f41ee3593da37fd92332c561907e07a633b9ba7bf66347cdccb378", + "68b25a8b5bcd76f92ed9473318e67e752b5898eb6b34c4a1205b77a88dc0214b", + "435b8c03368213b50237bb6f7a4dbfad4e7ba8d4f3948b046a5e95ff38c739be", + "f553b646e7933b5f766d1187c3bb1aee241ea0734ec1c6addc08871c43bb7c64", + "5f7e12488b0d469ffbaa32d1fa766352c8672ccd9e81f503480cec626d1f88b3", + "86fed64323e502425165fd4b319a848da156ed4e1acbec6ac706b8f5afbdc1e9", + "3273da703327df23094325bf9a120c3bbbc9388b4bbbec32a24b768f4d02669a", + "cd57f10c8a3c69b40ea2832dc35837d8a7521f2a17b2936eccaab7d5bf482dd5", + "fe62a9ab0e66c65344f94de1006ed30505bca06dcc7619ca717078a09afafb91", + "f83f5339fbbb59939406f37a8053030f00333d809da78196e1dc177209fd0e70", + "9cfce61b0d63c05676d62a7dac8c1362d78e2e686d6a8b53c56094bb2014ab96", + "dd387d649e718c5d7cd9618fab6cf60bae452924f4e0b36b9b9ee9d4b9738ef8", + "b4e9704f8937686cd738c71fa7250b970fe64be89c75e36412cf4288e7911371", + "b2d3838be418d29c1ebf100d269591a89b6e74f81b822cff71d8a9d9548dea0c", + "e31733d8cd5174ecda373492fb9ed3f56fffdac8f869380c06ee9f185821918b", + "3c7b69a99d3765c95a713d27af4ac28d7808ca92543062610bdf24edd3643790", + "cd639186013fa4488043c42b05357e82425a3e889ac14679eef46b7388cecfd9", + "0ca04c8edcd2d8a247e575209a9e5c8a1cf86c39e6655d79d6f85ef41556ef71", + "d8cb785d9bcf0b1a8289362c5badd0db084f2efa3d831fdda8ffbc5cd423febb", + "c932a2fea0cf3a50a44090757e856ecaa4914e385b566787b60877f04c947002", + "1d3d7b3981fee634842a7dc05f5e4d1bac279c0ab8e9df78d768f43676186340", + "155e5683914f9d0fff0323548d9a531ed582e72414b934e57edb656579cb05e7", + "486352981492eeca9626588e8aa0a737dedf797d83a20148cf86aaca0e5cd660", + "692125735f88d08d8cec81e5564ed2f20d88422cb693407e8b569f2b1e07050c", + "b9195800d5bcce2e36a49a8f49f1674d9913dcb526cf50d1097ce4bea82407fe", + "92d25db73aef0c89d7f6d45a21f56bf7c0b3854a0c8d19db7bc7247ed2244f78", + "9eefbecbf32c98775e957013ff48c835781e52d91e576f81eec2c079bb61acd5", + "9a71eba84ef99ab18d46121f3d387888c2ebd4054b85f3cc2fe90f8e75cb6538", + "5fec8b431826e32ff8b6d3da66269f1e8561573bdbc8602f3fb20fd5e1bd8f44", + "117d803b171807fb6ea627fb8eadd75abcb20606fc3acfea76def5897a986f35", + "71a5b2e0b33d5bbb1ac73e6967b839cdfbea4de2fc828ec34ae8e40f8dfe96aa", + "3175ca255e0323924a203bf8aa949691546196277c5976052ff0678a934fbffa", + "7b355ea64f6dfd26a0ca7c433c31b1368e70d785f31c71caff4df6883245d409", + "3f00299f644f669c39db368d2a0df198f572ce9c8c08c85a94fd8c7db9cb5500", + "3e4b1620b66257264d51007170e6b0c49729b4731e3e1d236d188dc325ece52b", + "ef62a3e54636bc30ce5b75fb14e4753986000fed2eca3cb11aab716c88729f31", + "53635a42011bce8fec02af0d16ca0cf4b994332d1ce09551b99693a1ed59d247", + "0e4f65ec98ba41eedab3df06256eb227c558f31fee052a4266b3539f7af08275", + "23a5e489bbb5740c0c685591e6b73a7096bb238cad11e8d7e84fc9f4b7f55207", + "b92a8731fdc1bf7bd7bce4084892f87e4d9174acb204ee163cebebcfcae6a5d8", + "2e55a819e3b67123ec2edfc304418d7fee50dae9c9b922c3a5d250d6f7c9662e", + "3b6aa69186293835af4c700678ee9bb810de2ab8899c93cf245e01537742f5a1", + "2377ef08168881eba6f35e080a5fed4608aa733dc9670f59d45ceee5ce08fa47", + "2f26d70299414d84d00c95be2fd40758bce2e88a1fe89bedf898395894f501b9", + "5c2048320f765e1756e7a743afa544a602d648311f4bb8495f3d43de0f8cea49", + "e08780a749f547c02460053e2a258b64f89ad494c042171f2e8a426f3c9a0520", + "97ae7d3c4e6969d04821c5ed50c21a914379c1a1b3b5e5dfd38b26438e249f2f", + "6e181d25ef0f246585e55b5eb77c8e6191fb135af98e816b0abd841134bd5d57", + "271afe681be4d6c7c09cf9b4010888525eb1efb66cc2501215894c15e2898519", + "e8e670d05231f561f6a2ea1c1e08a560a96bb2674ac72851dc29da697ac169ca", + "8726ea1166fc378ce1bc6bc99ba52e93416fb5d1fefd812ea29de503077d548f", + "3cab3aa4cc41da609f367c1c57db872b8cfcb7b2f323516266bb3d8fa36642b4", + "c5a186e0f17d7af521efa20982916fc813e1b7d05295c3da7730ef6b5a48cab7", + "1738964f08db1fbe6b5965f7721be058d80a4e1ec976ac743059a5b31d6cd7a7", + "7f10a07aaba3a86425dce315a22df012363cd11065229f983530e2156fd77442", + "d97c168cb31e3390b66dc4f61020d70ef36ec9bdc679c2b64a79dfc648238207", + "0db0f54012e0427209e8a7b14f787419a4a6cf8cfbfd7e985e34898c1dcc3b5b", + "82d9cb547ff915752dd430f4b91c03970ed3cc9e376a93aafea77e196cd1998b", + "88f50df0343fa95532cb3b9d60cba5cee24c7e245bccc8ea06d8803d43f99f75", + "525d6f86a91046bc79ec5e19e21eeb42edb94aa9c1a3a6ff669455aebbefdea1", + "a8387bac47d88608c9a58ab2916857b9fc2fd8a1d52fc5d16f79bb4ab8be40e4", + "57ea90041e625ad5368caca533f024381987b1afd81d092b28eed73f0c8c5499", + "3eead9155ab4b5705fa08efb59ff16f1705d2eca4a8d707e4f633731bdccd8e5", + "e1d445eda8d84d9b3972b06b657c3be233a2c77a2cc146988c3d076b11b2f906", + "0e6a4376c4e70a27e5bd632511b761c70d8fe6776f93691d26262e169965152d", + "94df997fee522b612e12ed3596618cf27aa3a3109bb459f16eb6b6c136538295", + "6397f7955219931bf05a5b8407360c4b71ae62002aa273ed85db15276dcfb613", + "a3880c761ca9d0019b08cf255540fa495d5d69593e9bd73fa6eecb41dae42859", + "33e09133f59de09d87866389533ef005fc2c34de8a4cd68ea1d528d3c6df4165", + "58ca35a7300e2d7edd5acee6de464da5593d81380aff9e99fad2bd1d8c0dee68", + "2d8220d8b7f51f9f1082d903f592ff051faa4c37a46fc131c31da1dd2a233ed0", + "0148345468c538297511e912438b1ff6f0bcc70d8058f87ff70b5f944946395f", + "cebf3f7bf74150ce4fbddbc693fd6881a8d18aacbb54b8e33097580fb330e273", + "b8213e35bb6cffbddb211df8497d7c37f33a800f3a729846b041155c2f82c7d0", + "33c0d02c59cebf05005b834b6354b9d11184238c087a253b86e5479209a57d61", + "cfa8f4a6860419485b27245e5f66228003a0f4fce6797dc9e7fb5d938bb61100", + "633e780f4bf491dd0635d773334d7d2ca15a670d0d78681871dd88d77a2132e7", + "0b51f52c0d43beecb81fb62c82a17850a11aa6faab7527ea4833efffb0b4a8c4", + "c295b4b3d54eb3f602e5b7b6f302dd9c66cad44282af938a158887a4b64e6400", + "a9979735925dbdc75c01667c69443c96f645e530ca0fbb182c1d515093799d43", + "9fffb2f1348a76b735b269ce0961460b780c22882cf471ae5f1c1fafea3ae48f", + "d06f59868c9200c0d32396ee176a3260ba3940e0fef382b1edeb189030ab043a", + "44110d2cf36273a7c292ad5a9fc73bfa40d5de4b0188a8bd5d28f6439e078ef7", + "7fffb43180730947e0ce0f17899806d2998df9a70c9f9850a0bf0d5ab97da3f8", + "93b7d5e9121a06853fd8e0b65a846bf7497ec5c9e769db2f721ce40770a5ad8b", + "e3c15c181160b97750a748f9b1ef062574f0899d602333c7c543efe7be6687c6", + "483fc4310a9c5e101c6e1592299caba75d191c524516cf48094705cacaaffa1c", + "e24b115dc5e2bbaa03a956e316f036cd74f284a2170c98d0524b212839ded525", + "bc6e44c74a39e34b2763f04641908744dda340b8ee026c24e6ab18298230dd6f", + "646e8841bd52d5e6f441f08b068b8d3a1ef694e427bd418008dc08e55f9263d8", + "27010201141d9d2123b140bab4c05d1e60884510022f11e83aa5aefbb5fddc66", + "0a34d5ebaad9e855f386b3362d8dfc509d0ffca45877158261eee625e687aea6", + "ad133cc1b1af014f3acdb5852f7efde5750b39eaba1978bd391f0e620de02e54", + "210d474dcc58be7f5f81155c0b2135d26047b8bba3b413b2aa20485e4cce68fe", + "0158e2507ccb37e5302d3d188bb58ce6f7bfa56a8d84c1e2f085796719fc3b9b", + "2c4418eeb0fcf9317e8266ce1290919cf7785f09ec07efceee9c9eb31eb2c785", + "4b325afbc98d6f4510cc2e0bb3e957113ae4945b81d29caeee539c2da6f710e2", + "7d6fcd1860fa72512ef76e0187dc7af6fb467cfa2e96f9601e0e8989c38994c9", + "88260afe57f54f14752828d92501cd736bd27ff95389912283e88faa97a75269", + "529b7bf7e34de1f5689bba72a58407f3731bd2cee8af78a53dbd15497faf9d40", + "d5066d261ad12b1f8692fbfc1876a6d30837395cbb121351d9ba61cf1b20cea1", + "b0f968a432800d13c601c7520bb36cc9ba52b24e2a09109fecc34cbfecdbe9ea", + "f82bb8ca1a7fd8998886a8fe8f00084f108125394b9621c6cd19d92f23fd8c3d", + "53df3ed8b2dd7c46d8c42882a6096bccf1d6c966cbef8158b45f4390085a00c0", + "117aa85101fd69718713ffd12a7b4cbaa9bceb86cb52731e69ffb9ef83f80750", + "10662bded3a99140e896de3673635e5d946b0536db96643d0b4c621d7d68f56b", + "06b6066af41823461a0773a4018a93e9e7dcd71afd31331e5fa650b4fd1ac2ce", + "eca317877601cc31ae62fbd401aaae05a95ba092256beae0a69f90f42031dd40", + "040ab49439c03cee7663bd46349400cb389c480732f583aacabd8aa2281ac141", + "9d64998ae03ac69c2d6157548cf8f59eaf0ce08f10059bdf50ff8aae62dedfc8", + "104e0c71e792ced34e2811d7ec98f691d0740d260a8479c5e352e6d6185581ae", + "09d6c766aafeb3164a7a719920d7f9b871deaa9dc84691e8073f0db23975da39", + "40a86c0d81cb5654b51d4447a6e348a246decc7780581a9aa2d60c2f768e1de7", + "378243809750b9f1750d2d1f0f9204ca18d490e7458afff003f86c8cbb255dbc", + "90565ee1486201dcb600733c58934abb476fb873581c0e3dae8aff2ea1ebfe5b", + "f5dfb739730436eef0a9ed0f8c1c7b982469df5d6c042d321de52ace8d3a2c15", + "34c56c75a6772748996ada2bb9f2ed985d65a7c6de0087e220f45285846cbb73", + "42fad701f64b0f289a69aab6d432cf25ea365f4966a478216977ccbd5e25c19b", + "ebf4109ffcd719505b5871ad734ed07d7d1718a173977d31106050ae7bef2ff1", + "df543c94ec4b21c6fb74b805b76a1f3c855d222faa8599c060f8c85020e320f5", + "ce720073f337bb4893fa3a3b1e2f8e86696e5179617000f4f47cb343922ddd3f", + "786a19bb3612b1d1110134aefbe6968e75bb3340fe8d3994fcbd0e905bffc18c", + "256345974cd78d13520d2e43ca98d1ca0d650baf88aaa6b8db75c80e6505b101", + "2648c4f69b677c285297aca3107a6770c0a4bc1689dde13e6b5b59e8af91940b", + "752195dc0695f44531be939deb0f9940a9eb5273117c7705768c2b5edd6a70e5", + "1e4da8e8647caba2f3b358ddd5c25936b46d87b9e118935597be60fa58c6ca4a", + "5be16077f567b7bf0034e61bcfc0311887588c95ce57c0e2fb430dfeebb93736", + "ad205a52efc99c249042c9a2a85f6e39a89ca00a1bbbdac176bcbbd2f6ac6418", + "41414f5074402bc65ab7cede304c467ea56456ccc4d5a99f74dbf698ec80a014", + "f0a24dbc494b779606b3fae942042ebb6e42d77cf188d81f5e0895215f24d975", + "ed67e0034372067628553cac0f55d69935203f102d2eae5bccf3e9fd6f8bddee", + "1544c144771491cd8bb6c79ebb199070189032a209a17ae0f5df17d95e0a48e5", + "e2fdafc580819c643c0a89d3ee89d934d4131d06f288295e946b93824e098863", + "6b16af8419f1b67c3d8176c2e2b6adf5ad345d84c797d4621c883d12c5881eed", + "6101922fcf4599ad00260237e8b14904716156d58a25c638578de9775f6546c4", + "0211764bef038cb43a5c8b4e4e1c2189e29c63acc195a8f18f5f52abb6c2d896", + "9fdd3d266a5a068ee069bc4df1c9ad13f5dc11503fe9730fc069dce86d2d0cc5", + "501185fcc47f5bc79f11c17aeb48f6a069298e4538f48c2335f5a5cb18d3d4f7", + "9039f3d010b09f603ec640edceb7861a36dab4b82364c69a208040c3ede48f17", + "751f234599524ba682a48181293f9f24bbfded0b905db1400c4d66e287ae6470", + "c739f4bf1f227963dbdc0ba653351d9b1755ac4b30e4e1fc29a552d1763752c8", + "8e3b632fbec986c803e343ccfb4c8a13c03b04f6212cbe161efe5d5976eb71d1", + "1d20996dfd8ac9c5cd8de5ece58b61abc6e482999a720d8fc6cab8017adfde73", + "74468a7e1be2e9c78afffcbe10b6673e7522120d6679186fd21614fb8d3260fa", + "e47b686632ca64ef9e44b6da170481087bddae257940e54aeaf807b18edb4120", + "23f33513eef75806f25e55dfadf2e09727569c6c57dd020b686cef0c9a6e8324", + "8d59bb2bc1e8a2546b70e875ed5138dfab8f5209888877a7090294b3ba3e8adc", + "92bc28c793c6cf7200794bdbb5c3c821fa205ed1b4b06fcbda8d0124d28e3136", + "cc61018d326cd22a23b07c05db51cfb87618046132d4bedca206cdafa063a20a", + "b370ee273c4fcdb5bde8fb9ef6ddfd45406447ce19c748e418de854c2f0362e3", + "6152c270f83886cf3f5761812c6d8eece4cac8c348230c9b42dd271d1e3f1aba", + "2a9b0d00fb1eb5564fd96a8c1369f9f8e1d32b947cb59a334d47b32c6d963897", + "384c35175bd92ed2c097eebdfa72395a309acb7aa60c390ec3eb66773b661d6e", + "573e038e86e51ae46e5a7992fa652fb4b92632a7065260e12c46d1fd6effefb6", + "005be3a45b8fe905f0d1a63f1306ccc4eab8191d20f6f5a805f4754c20ef2daa", + "9a60982d54be5edfd5af1bd9f7d25dca0be74e77d5eeb6eaf37dcfe06cee188e", + "676257a1528797108e3a5fe031627338e9f09b44297e33aa1463cf46e5bf7db3", + "e7a241cb0337b1b02a56acabcd77baa1363feda4f01cda38d460822da991e3bf", + "7ac458257132ccc040a84b03c9fb7b9ca4fbe0579e7d3428f584da04b5b33527", + "cff2be050d602ec4623227bfe5d17c81c6b4da11e8c00ad7f7ca7d4c6acc878d", + "c07b292e4500a3ff9845bb55d6d69eae602d939e7681ae5d65effe80db4626b6", + "47136ecffbadd0a856d93adf53a2e2b675403386663bbe766bec37d313c87a10", + "eb1bacbee5fd2a2b50535a70ed300e93b90491d7d3d29d2f1f8bc5ecde0d7839", + "15e2db68968bb0000bda5bb3747451926355e9cd63db122bec12a53fb15da9e1", + "1ae6a3722ce9c193df69b1b8a37aa086ec323283628290f7298871676d3c4cba", + "65477882f5794c720233a98e1e383d91deb070f0c2bceb95a5efe7008f854cb5", + "2a630b24aeaeeef20baede1abed05cc9c45794561239f64c6bc291afb4b16120", + "70beda84b736a344f503b4e25e0e4a426f31d7041d283aab464026dfb9714457", + "591cd0ffc4b3b51cff8621ab1458a478c0a0f57305f0551e9e5396dbe8f7d349", + "53625b2b7fcffc9568152e6b6d95472fe850ed163ab341044a0754334cf22e34", + "5751606d1ed8891eae9bd10c5676a54ec196b36b00f9b7d3aa9ab0ab04b5cc25", + "f9f8ac5616f2d1864a6599bafb5f2e6bbc7fba72d6aa23d9ea1e0096de9d4164", + "56241bac3d18e635913ae9db5fac9cdde4e28d74795a1ca77227354d8d38fe1a", + "e01cbe3312394d636a19003923a0ff3eea7f8d2e1d6b42f94777655add3fe9ee", + "d08709244798a43e91f24367176899d90f8678813ec8b822163c67e1740f89c2", + "7571cf1e503d83dd0c915f69b8365e94a1b37aaf98a37d08d4b90e2a3675220f", + "f43f4e2cf5990ca47a833947b671586123e6e73a57d4305a9b813a8ed0d2fb8f", + "12bd6bd6659343e3dd9e6666572c55724a0a9e6990b890b556fe662db9d062e5", + "9ae85f24c4abea079e0223f9f05355dcaf5fbb396291c96d5c3b016099e84bbe", + "495097c042dc6319f9f6480ad049016f113b9c5cfc6d612e04aad56934b919eb", + "4eaa8cc1bf14b329db1097395c1a5ecd0f6fdf5a5de76db7f0339ab9b2c491e4", + "9d9f56a74cd94f45656c40e09823308aed0b4c9e745203cd5950138713026939", + "40797ecc115fee18a4608c9efa1ffeb81c2ee1c4842561ef61fcf7076f1ffedd", + "11cd767ae016d95635cbdfe08538b9347337d6b0847d12697075584b8d0619f1", + "71cb92eeba1ac9e0112a7cf621767729fb77eca209140f248c04f3ca1b0918f8", + "e44a0c43a95543503268b2378dfa0c9161c522c62bee65fa4f4a238875c64b7e", + "8715cacf99e5b7a106cda39fd2b6c96c2e5022974b0f66de7d6a15ed2aaf4eed", + "35bb68dde977abf2784e33d1bf3052893a358a43a8b258bea6a7318b1dd4a310", + "b5bb928fb28bf9699bfbabc626fc279a9ebd1ce6b63c993ddeda7b9eb2f8cf27", + "3fc619d1072c86c3df178b90349411bfed86c49dc777f030f2d27e3100394b00", + "05ede74d5dcb911b02053a895751f92ae86743298c8c6d8c5811de191cd4e5d0", + "18ad4372b90d74e60d68a00e4586b0767c060f9c522d2016c515cc5754eeb06b", + "595447850210071d76266dff3f9ceb530f5fbdf38c9940011abb9b96820f69d0", + "3c80c4cfbea01760facf853c328821cbfa9635adf55a650b92fc41bcfb19c8f5", + "e4feca4d382344176e8ac45592711e4472f76e0667867d469c65ccb5be2c7a19", + "7d0b37fb8ac67f6752e21869e57ed1d8b08be8517ca53ac2835cd2295df094ed", + "4af613e520506104185fc529b07037168b79165ec93e37331dd01f306307a9b7", + "103fa19cc7adb309027f4eafd56cee2c11875358bb4d8d8dd2bbc2f3fe698bb9", + "ede21fac9950f370f23f2a674f795bc7b2eea5c4609ee32fa64d4239218b3d98", + "5b6014bebeefd652030b6f79d14252c51a6f1159a2b37bccdcd3e515e0ae27b9", + "dda18f566e40a3b6e882b5f35ed04328ef8288094d8151bcad76a8c228454f6d", + "bb06814f937b8f4fd23622931286468bccb770a49112c94b23f06e97ffb7aa05", + "9c629de1ccf91a807ae4d7c296108a9ec7880c1cd278e0da344061d329755c14", + "6dbf2e32d098163480ab02a98344750fa5daafc7c66adf4fe90d0eaeeff4f86f", + "4e93b1d6b6d8ee75bf09aa1789933ef1248397e1e3df6ddf8af74eaa04d59c3c", + "6e8f38e9b80a674c58e2d85fb797e0357cd1414528a175f8e06a10b15455bc91", + "d397c5433f574c1a5f9d5c219c91131f3823694a50e04a6a2d896458b76f2e2d", + "f50cc41a1fbfe1a27916b010ce35aed4d7f2803e571225ea1382facd5a603139", + "f375dc182eb989bea2dfe5c2e26a351c3e2c2ea5c8f11447f34004c5c5ca2f27", + "7171793b9c6db5102f6088265373a7c57778f18f440380255a390d5745113652", + "494461bfc7dcc180d454bacd79e12b4a12598e3cf2594b4a96001188df71f27c", + "4ccf4da37de3d59a491675a6cddcc6323deb914a8f458fe6bbd20f4ab824fa69", + "74d21ad3cac9cec15832b98239679ab6360d84ae3d2a36a3f02307d647e7719c", + "b7b45314da2fe600d6377531a57acfd3f5d44c2f0e8641d67f0c9288bab8a3ea", + "7e9025449366165d1e1a7a84b15c89acdb7220595af59d776716b7caf76b517a" + ], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.559429201995954, + "build": 18.58, + "query": 0.0 + } + }, + { + "case_id": "nodegoat-repair", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [ + "590ded4d9ba52b59e2934f3d461e45dfa5bd351f13c4fc17238297438fbf492f", + "33ab14574877d6a529a58df1926e358759fb4ee1ffbc68146aebf77a895c8eb9", + "489bf9f5f3a1e3771698cf111c0e7fa3e84f81848869c88a44cf3d19979d168c", + "ca3b943eb07fc11f6cc16228ae4e7813cfccac5dfe7ea9147deb0ce84677e486", + "a83d9fd2d4f399a40984cdc63e30003a73c98a6986f76fd5e22ed0ed7873c8b3", + "593c9114695f69035b4df9d566534e35fcfaa2d78a3e4362c2ff634580d6bee9", + "87ba1a35a429f850990db0eceda9996daf572b97b32b38e0f7ff4b80dec9a6b2", + "e9cf95baf8cef9a83d9da86e0bce276421ed404867ad948acc338fa759a3450a", + "431521d90fc22b7683173732598c39b94a25447f7403dcd4d9e17ca23e243a61", + "d331868f74b26a35872e8eeed4f66f3e34a29f8e9745fc14c1609cc3408aebeb", + "61b6ec72d6c0dddae427635aca3c97681a112cc4c5f8e4367d9f5864c6eb72b3", + "e831bbc3ab250e71270b1f5175756f39c2da662bffd68b2ed78b5389a4f23d0c", + "082910c464337b0041733c3c2733ad7947d71549180f9a0b8ad4172901469d02", + "14541cd08e0b036e4ab5caa442c01459fb03a6e3ef0388bcd0347b121effc6fc", + "da4abcaa22e13947dca90ac9156293bda9297423304d60d587569389742ce17a", + "29000feef9d494e003efdcbb6eab5410bc93ad2f4674df9db389ed98a9cfb242", + "4679cce5fa8da06bd1f9542b5a58321d2b090556cce83080b6e9ace36d352a59", + "df4a0610953efc25e4ddc4bc942688434be889411d073fab09015aba97ce2511", + "9b7910f9f96aa714b760481e46e543ea413d6e4763b858a3d0c186a560ad618c", + "298f3d69ca3e2b343c9cc5288680120b89e035bfae803dc6f6952358b6d0f1d3", + "7fbdc1e100a0b9078b6a2d6264bfaa596c64501b8c5ced1557b56a3d98e2b351", + "e4fe7eb3e5d57766a2c6adc79d46b9f57ac13ba11df7846cc4f7d62123a51bd4", + "0cc9059de118ef8da2ab45a3453bb2f64a679dfa33233f3b1b722b3858df789b", + "d561ce2e09d49013cacec011cf5dfa8c5f35c25c41085e856b3d5f28579ba6f4", + "7eb45f19bf15a2826d7aac45f36137de8824abfa9c0d5412da3c69c5d6da7a0d", + "ef130caaa2b3321cd12e2c8c39a27f9a868d2405e572fcafa5cab93900d9f97a", + "115b829e9b03431b06c12212efdcc2da02b5e22953e8a02243a8cd5a59cea0f4", + "db0e20f3ffa3b74105bddd565ba608daaea4cf9baba6b43a2539958e1a8be668", + "d2034c51a6d44b7b5cb553f2ad130441532b6be68cac0e829b74c4240aa642c4", + "1d7abc4a4a8c6023e1c5231f46167efdb6c476e4533ea4670a17ecc6c8d09c92", + "ba984e9deee4ab97a4211ce15915bc36e0e42907e21f40525be95c698c439653", + "ecc80bd3363347eac23b60a8ec50efe1a5defd3609aff7149022fac1e74524d4", + "7cead756038bdaf46936671d2311c93b391692337189bd9f3acb5711dcd1b594", + "d7044d436bcc3e7e313fb2baff364c8aecf980b28741afd4d020f858a47a3909", + "f0fb49041bdc02002b8aaf574a29a738aeb235ca0bc5cbbe9998dd9841e93a0d", + "f12e400682d1a222abca9d05f942a24394d7795eacc7ec322c585a0a6ffe69ec", + "5e24ba3194915f95a2452882fe928f834ed4740f8fa2087c7573b7c2f128a2ad", + "4d7554903c7ff3f7005fe4ed77f7e82af8cba218d3ac0b431acf14d18ffeb639", + "896720a23ec5b7da3163d53b517817cb01337cdad64d2104dbfdd3b3526f9c5f", + "e13de3ef10e25c529870483b67e47206b9cd32251e118f20f628eba95236d9c9", + "ac5ad3cda567527eb97dca35bb56d076292b88e20baa36d337967eb1f4f63dff", + "7c0bba65b77fc890e479add54e7fb0e9a7d145a4304d81f614536a8470d0a471", + "4ed8fe95db377770a47a2b3ad04a3a720ec21bdbd5222272ec5555130a627fbb", + "ece73e32fe91c87a001f1e41342e09378041ee876c8a8846a51347b8b607cc2f", + "8146eab0359ca0b822353b632ced69bf09fd449704cdf7c6f84440d7ca784cef", + "ec7c01083f1fcb35c35244172a005b3eabebff9c0fd1dcfb4372268f82fb3894", + "ca89f1fd26f88f845f394fce84527e83c6a4cc8252f30d6787e7c5ac13e119a9", + "c3b4d527dc5c4ed121a487d5e4e3aa868df773ef3b04200802f9a306bf67c730", + "9e5735029a42e23af56c2cc802655bf46c55bfebf19f19810ac16cfa15fc688c", + "a562474ca19fd4d4ec052396b656b092e82be7b1c002746f631cd9fb68b39ff3", + "22e26415a3768b1b12cfb9469b912d359d0804761ee7f1d02d281600373dc8a4", + "03548d772fd2a4030a9f595257333eb9b323f1057a2a0399ed15efea113e719d", + "0f5f635e19864fbd276fd3eb0b6460f86274e6bc52533594879fcc42c02e4df5", + "f95e55b8ae987f7c4b11837ddaa8dac8bed46541f6d8c12633b46fe915b41824", + "e77b04a213011bc3e9812f81c2d1266be1234ff91a72d347b71017e8ea09f4e4", + "f7ab6f0b570873d6b99c3fc33ab556f093d7f5e4991eac884d3e766a2c29b326", + "722bfc188cadc50c1485cf4ede13f2b62e93b08b16f42f2586c104b8bd3745e7", + "144c1db7c40aa0a420e02130a756c7793fc8fa5d33549a08c236ddb96bad2df3", + "6bb3ba6475ce8d11ff20924b69721387bb0d4bbce1b852e640403dbd750f0a8f", + "a08e3f98d65d0452a631a11de0ef53c9fb53492efcf3d8003b5512478b92b4bc", + "4e0e78390504d44716e20ff65cf5f16c1f1ddc2fa0441e503dcae1826c666529", + "0e143029eb9d5d5c30c3dc0fda147c852e68d4e8d407795a1047beb586723238", + "43e8934e37c9ecda6c36b4bee6af63f4269e59cefb5df30af45ae08bd93f5063", + "6ad6e59fa1a92132e095463bdbb461598c80b45af85ff453a6450b59b61d10cc", + "c2b3c06e92fa87731137f871b9dd0f867fc53156a80bbf00da955cf5bfe0fe7e", + "b7b9b9cb1194740a47fa214266a43fdb70019fa1308009589d38f2c7662aa4b3", + "4d3ed9000a9b5806a0ed641e2739166e3df18ffa1925ee396fbe25d29e332c71", + "bce9e3fb76d6276772f1f279260ddb2f673a4a45a08f13fbc75343d20c0ad4ad", + "f0aa35455461c8f75dd8ca533e03dd43ea339a7026f07407ef26b12c3fe6f44a", + "64c0f7e52fb34476d5e47478ff354845a776dd781a2044963cae3191bb18058b", + "9f9eb159649a2e07879e36c4f5eb5bbb38e337540c4b295adb4b59ca31e2a868", + "bfba8296d9252a696a7f8262a80b63019fd89fb866e3d3daab087101c9d7ebd2", + "6b6bc1f8b05dab47833d180de1fc7b40d8637a213c87af02f19bfac2f9439869", + "72261efc87c3f66bd420e106d6e04235b2d6a7b4c59ceb5a235dbfbf31d02f29", + "94e30a15524e236d04ae2f0238a72c0b446a48b7b4302471ad6703861948025a", + "fa59397c0eb909b5b269278b706ba8432004d786cc8431db1e27fdf9614211bf", + "a65d452c03e7a0e7bfc77d9337f0c3f6cc47449979963ca1173f45c619b7b812", + "135f8cdcca313308bc5456466706c561652768149ff61e93f241b383c07448e8", + "d029880ad27458bf1d443088b6afe399af206a9f412fd8406769198f304e64f5", + "2ae591e30078f1e045b446004067a4734acda37a9673dbac82bca972cb5f8c2b", + "b35cc9123b9c6316f72cdbfcd7945157215622625141e56543a4093c0c553013", + "c8d88ff3a98aaa4eba3756a5f0b89cdeeeda10e5180f5eee0d3ae2b7dd042cdb", + "f06f0c86aa4079e5d3ac48ffa9b50661a0bd2f4c315190b26f13664de494c9d9", + "627afe91ac03ff52d178f64eb23d372523f86fb34fcc0ca0dade6786c38f0dbc", + "ccab701536e7f9615e52f4b1a1c68a2416263ad8de279372ce248fed5d7868ed", + "bb71e211e99f3dbe040a15b22eb7e004da953ca61b700ca3d1c94764cb6bb80f", + "d799a15d3d810c39c4a519c59843bbb6c2617f559f8ebdefe801296e0819149a", + "d6a24a60b3cec846b01cb2c3a1535ee2ab834a09e935abe70ede278ecb1ef045", + "d1cae428bb382d9cc38acac1c7bb8a5e6142a46f5b0e6e2ddb1609b0acc66f68", + "c46c90f66921363f974dcf82aaf3b3410222ec081abe097417dd1a1accb372b4", + "5630ea72ee47272cdf5f9e3d1df3aeb499c357880ad49b26cff1cebcbbaaaeed", + "013a84070826e011c0b19953b3493276e98498b3837618303aff28475b38eb2c", + "c158a154e2b9394ee661d2f982e93af8d59543bb7da5c8d2c8e9c65905384d4a", + "a0423c87fb8581f1897c9a0c774c3881ba8775e05f6cd88408cee05d126ac52a", + "7e9c5dc7bc705ee6825fcebe23ba885a4be30b318195ec89e9a19b450bff86fb", + "c6c5a131a84fabe329dc50128240b463b18a4ea0af2d036bcc02d869ec57fa7b", + "ffe9fe5d19fd7233e88869bdd2f6fe00785a9b15d074a3f8b171a03121ba64b0", + "324cdf414ea58e6d9496c28b138b43bb18cd6e983fb7678aef960670a51dc93c", + "fb3bd242d8f9801589ca53c24a1b36b88ee1e6b8932ddb6a5d3bb7b3019556be", + "5784aa43502be5cfa00e65ed1800bc86cea1b83db7b99737a92e3059c0aedb51", + "e05d1e4da035294fb1b5185492276e323b43a33c173dd05390edee2726f82f60", + "480a6f9e635cdb839e9ed2fab13d22291dff3c92ae99e1bf514439b370480f24", + "acc5d491964faf3f4858dce3bfe338199f9b5469c1ad33e64c2f0bfad2f0263e", + "e14724d931f179f9298c723043307a99153207ec425d4fae28f78becba7c0a9f", + "756d4aea97736b83d6904a6d96d22e8026d24796d64d6806c2fcc478272c16bc", + "8fc292a32ac35211b4747151ed7797cdcc9cf7edca0ea697f9cd9ca9eb2bf906", + "0434560a038fb3a29aaeae6531b7190a9a993f75cebecbde4dbc5d9f248c16b9", + "5c7e3540a665e15247dc85c88bc06f2514da2cd85010ec820cc53548ac751009", + "074e2d12c8900202ecd6b02df395375ee6343d1c04c22982c214e74d38fdf51f", + "cf2f20c22b8acc270d75b060b45b3725d2a4a0bc4dc33adc9feeec336fa84f31", + "bb67a42d62cb5389aeb41a0e18d26046ab4f20feae70cba114ddffd5995ac3e8", + "ad9733cd531deb592afd4650ebd20d8c967ea49693d2954151a70f4a4edb68df", + "572f510d0485395c2ff610cd031d238c3745f79fe98a8f9fef5b042c24e57b69", + "0ae9ac017e10c4d6256d41b99b5e771d7e8acf05bc1087acb58148a8ea2e8c5b", + "691315c9798b266ce8aaff0a6368a80e40c685c1a8e3a54fe139131f4d6da7a7", + "aee4c8330dd8ef28010fdaf243964d48dec427871626422da8d915843534755b", + "57aa82c0185ff3d73d91dfcbc6bae9b5d438cf064ed0ea9489d6b5de7c3df531", + "79ed0c8a9f7d6b06e75ef023d6ca5a32416a9c8fbd5a75fd97ea1c0e8f7a5a30", + "23f9afb28b6b7349cbf502c2a6a1ffff117d2b3a974d8705b99fc8717108627b", + "a6f0fe4aec662565f32d93874690023ebe09aea9a887b330e0c64a18e41dc966", + "aa5a287a1749ab0ab4e4b56048c738b95df8f4b19a82378847a39ccb5eb42315", + "09dff44163511e71b0fbf539655ece1940bd80039bc8743cc922699a37340b71", + "567b6eaa4c3dabaccdfb44885a6a4cd345ce3ffc6a201265084c1818c0b84226", + "881e7f1a45e2d7ebf74842b131573da24478db0c44ddaea50ca20007994387c0", + "e9a98c513dc38db66988ce7ed9fe730df4ba5297f2495c77a54ad2aa9195b9e6", + "f7484f28717752c36583df6d2167f9861bbf8368ac7f18b8a7c41ed41f301f37", + "c0c4a04d19b7a5f1f33fff97f49a9d0245c4b14d24c3691cefbf46b76c064d7e", + "2b86fe6715dd628b59d2303d2939369a6ebff338e7c9a3f41a5e76371e70d56b", + "3663dbf64c23ffed29746c390953bb4c54f0f3154cc9fa65e7bf6acdf7249702", + "8beedef6ba5098ea3567e7e9dd3ff36fa7ccf418f7a8dabc5cd1c8df83ac946e", + "07ee5dd2f228e5d605f204a0e607fde140b169321c49486f64ef0ef3498defed", + "34ca592cc7c4769ab6ab180436ace3d801b26463a0915b253459fbe8aacc7ce3", + "2ee6a26bbed8f2554b909b310e8fbcafea825d9016c009fa785f34121053ae17", + "6dd70277e9e05c3828bec89c4cc94f2b256eef50554fe78b7bc7805ba0c77d7d", + "448a4023be7987eb4282a5534d6369f7e8ded7ddb3cc29c537a4e09ded04434a", + "338e654fb02855abf17360c328f02986bf949d898b489ea7b9b29ce090fd1eeb", + "bbd12c331fb019e0c84c5629c0b4945609328a196e3862f6f6dbadba31da81c9", + "06ea156efb68bae0ec77525ddbd4eb18c1c97512cf524cdd7661286b48a2684a", + "163b26e0bcc1ebc83d620624356e8a535ba4a3130af719e57a4dad9922d0ca1c", + "ef7c18370144ac600fa593af56a8a849f7070b91261415e8e3cad6bcdadc80da", + "f196cd68d51074be3989e323fc62287af695b781697b91b658003c825b426ce6", + "a763fb136aa3978b7f47acb90aae2c6bb5715e8ca5ef1088d7856608c8807071", + "5bdc9a08c76139479780eda09106fbec03bd5662c1817f14c0893abe4c22c798", + "4d34d526ba5ee10314a8f6a74f7fedddbcf0ca79986c20a5127dbb08acfd6c43", + "2c2899bd893f9611640844c56b404e5b91768151cb862ff497bb823c505d568a", + "be30cb63922297543ed6c72314d3b6ec3d849d3c5d28fc3590ad44ebd82c4f0e", + "28f1d0d25c8654cd762a439d6eb6f3a6896d37071f406d8edeeb4c20adee20ce", + "f6a81369acf1c84e3cd6bf3399289323cb47848984a8c96800c0682fc1055a04", + "94b9c4a91bfce96cbe773c203dfdf22d1b015231e91dd478399c2586be6a3e77", + "526ce466755c525287df1a2adbdbdf566c896d79150b9bc7dbe65936e83abb30", + "57dcaf9ddb9d8b054aa5dda6a0c9739439362e898cdf22aaf9f7338149f8cbd7", + "064ff0d84035d834f9382eb8b4ad901fbeb4aa9fe816d7c36a34d56af41817bd", + "d97343cdd389cd2ed9d0f1358d2bbddc2752053d95eab3e16e99423298a4371f", + "f9deb31f0f9b98cad69111389734d43ed4fa86f24b05c9f2d48a78ea7a8708a3", + "f962a89d04810a6c57abde4a8d3182d2a31c5d0f0ed3c37c053abea1fa223f31", + "b62ac1b4b282eadf241f508bd5769bdd440b274f967d6ca73cb685ca249bd287", + "57840b0da13c3f6f67e587689ab1eac913c17e91d493d1ce9ff089e8dccdfd29", + "e3d1ce3b9de0fc9b48f2432d5e64947b5b24c3acaf1166f746bff1c54a028b9b", + "d322db4b50c2c1bdbe0e22ef291070e20c93e0f7199c184f5ff8b4795b55cbe9", + "88371d1acc9bc3b69c1d1957b27c9aefa3835be37bba74a359c35b1beaddc2f7", + "3486da81fc55b7e285f23e85f44c481d780090285a384cfedaefa27265a236a8", + "c87588b38d18fe9a5c563e2ae8d79649ce699607a891bd41b68194ce4507137d", + "d6e3d356d491e5f3dbaca74cf11aef9bd751b36737feb34e466b707156b0d779", + "843197ad039bb4e840b949b0ed1e5cf2230829366646a92ffc53d63e26149867", + "b0766042c55d7c370799af987bed01fed8a417f83bc67e21d1366988aa1af10e", + "b788ba22bd4225c24f95821dbf1f467dc2b13c7615b0bd2b00c3b234b7519539", + "91430345496348280d29d11662aeb6048fd7596fc6304380b6154494df30d154", + "8c1be7b4e8fd13181be0c4e46350a2f972e24acd13427e71c15e60dade41c28d", + "f87a9ae1d7dc81f88c5891890b889aa7212e172ddec092182b7de6f01e787d7a", + "b6a42fb01b464f31f65ebc10fbc12fccb051d8b44cac51a6818d3aedabea07f9", + "4a820a780053b6f65492691e067e236adbd2a05b467e4e3f2ed37ba1260ce84f", + "b07131192ab22510055930477ced5a10698278b2e00e3f711ebc202db640bee4", + "5fbb00d9b2952ae4f0fed217bf2d8603872d8fc93073d99f31d8815539121987", + "0bd48e207e95be86ea4e459c090a75c0adac8ca31bd2b631043854551b2c4392", + "b11de5874aa62f939e383179c3ea1b34d3569ec6ade901964393b92f8325ad11", + "8cd692618bec00fbbf099d570561201a2d0fdb601050fd20e198ead478530675", + "19345b5fb5cecfc86e4db3cb8715cc7370e81796d70f11ba150a13c5ea8e4c37", + "3ad0b3549b82f93ad869a9341397d394c1acee5e18d94a699b118094dd7a9a70", + "32220b1bfe511b9dcec64d7ea8f4317e96b2d0cdc10bcfa55cfa3b63ce64aab6", + "0cca9d955282f37dd60e764c56b52cbad90b33ec2c2943a7e5d155d35b0417fa", + "40d00274aa5b28039b0d57d75a81f174c0a31e4be2d324ba79a64b79efd4e411", + "319d00690097314e26638e2f4a6d848f50d1ff2f9d6f755a618eb31398ed373a", + "dfa47fe83d195de69774c841747f6e7ea78d6d91297821dc9b8ee5fc625cfe2b", + "5a497ad4d83218c29d4f22781a54d9e1927dc414f7cba6f89d794ed047f8b245", + "1bd3f2289cc1bfa889496ca5074991941263703a2517281734f33d0ef1050f1a", + "587a689c0312ac0f6d98de7495f01f34428cb128e73875a71508f7d5874415b4", + "fc77f013f48b454d8703f25f76646f74b74c9e4f8e5d542bc5f48d98c6e51fae", + "a2a7af80da34233233ec619dc29366b40a9e55ead63626db185524f2415761f5", + "f180a77f032bfea9c7d152438ba830f19e1bfc88481a56b9e554c61d2cd64f6e", + "cb70e9a1b44fa1f13f3bcc5290e6db5c8d6eda83602c9513e91e779ac6cddd3f", + "74f543e29e519871aabcedb9d39c953d5397aac456c3c5e6eb0e10e517989eb3", + "c983c339bc6881a1e6a0b2c6a794de858613b91318205a623dc61d80c2238036", + "97c5314218bfb458e1fb6d1a33c9ac75c7de152774a736f6c5874657515ccfcb", + "0744dea5a54614d094a6eb711ff7df94a180bfdeacaf330e31d9466cd51aeda2", + "06dc1ba86d3fcb46096bed80d9c5c558f79a5a33f4fcdb379f1567b1271b64ab", + "aa48541c8cce586b7a8c5e8ebe3cb607d1c283ef8940b7d4c7fb584327dd177f", + "a9d086126128de76e0bafc06ca465176ed2884cb7ec963457fe106346b8094f9", + "637323a350346cee17c66cda9b8b1be49d58350b0a0904bd61e5af20ce611df5", + "aa25524f30b8e84ef80b52064a75ca56cf438e67e2696e360d683c03e85c4c6f", + "9b5371eadea2bf5707f730896b4766a8b56012269f1c02c5df9d0df1d1cbf696", + "d527de43dc2dfdb271c213a927ab31c08b1f063298b211b6b11831a4dff51922", + "5ee4f0b0ba2c39e7071bba12da912c1ae213b8a2cee0bb437afa500328a237d4", + "43d3388ae21433a62d37d4c92861c125683f03a0edd9d1afaa56a42a7b793dc1", + "cc8161804d4c84fe4c4f7210a16193637accc1f791b7fc7be026c07177b7da4c", + "4bc68b77bfd52e96e8db4fb7293a6d4f396d234eb4dafb625df76bc8f1ba1c7d", + "a66e57d86751f21d11652bc991ffe476eacb638f38f95947b723ac9448c5f668", + "278e2e9a97727da969f8d122576dd475c43141146f984e3af997600a013f19bf", + "3152613ac0763b809bc99a50b728391cfe19d2cfeb27ff47a1e3671ed7526a3f", + "06168cf4f7850405f47bd8cfe013dc077b51457b355698ea3407f998cb561c2b", + "44620fe943880d4498587b283cf31a67b85fdeef53f59223299018c3666ae32b", + "eaa4fc381ad8dd4a49b66bbe7ccb050b2ed8735ec0d5eaee4f555fce0ff39a8c", + "68a35789d8aa7b4f5293eb06988118bf39be4f0354e6dd89674da130c4ff7911", + "3c9cfda0c903ea8e97a9bdc2966dff555df6580479782ced9ea934837e3bdb5c", + "4367699c5a75ef7a22a52ca8d1b77e15ae6c8c18b2ec5fa929d688281ff34edb", + "f020689fd3ee8e3f51d12f177d80fb80aba8d3435a9f58e63cf4caadc02eca10", + "06f7107e12e2f2c7151d2c38ca31adcd8690e7dcab4537b37183561a9306208c", + "2f8516c90c01cfb4bd29a3b8ad1b61280436a37804b24929327cb41d8eac39aa", + "8f51fe6438299d6f935f48d1d0991270ad477174195aff8574ef587a45038efb", + "8d26ec62881cf7efa89509047c178e7b920a87cc4bfb9cb0d6d991e87ca22124", + "ec5cd96c01771e651d9e09445c5df8af453e475da75f47a583a1006e99686b09", + "2981a228c15eb8a02d051bad6ce39736dd5f4c3f63a979d997bc23086105cbaa", + "7055c8f3c6f41ee3593da37fd92332c561907e07a633b9ba7bf66347cdccb378", + "68b25a8b5bcd76f92ed9473318e67e752b5898eb6b34c4a1205b77a88dc0214b", + "435b8c03368213b50237bb6f7a4dbfad4e7ba8d4f3948b046a5e95ff38c739be", + "f553b646e7933b5f766d1187c3bb1aee241ea0734ec1c6addc08871c43bb7c64", + "5f7e12488b0d469ffbaa32d1fa766352c8672ccd9e81f503480cec626d1f88b3", + "86fed64323e502425165fd4b319a848da156ed4e1acbec6ac706b8f5afbdc1e9", + "3273da703327df23094325bf9a120c3bbbc9388b4bbbec32a24b768f4d02669a", + "cd57f10c8a3c69b40ea2832dc35837d8a7521f2a17b2936eccaab7d5bf482dd5", + "fe62a9ab0e66c65344f94de1006ed30505bca06dcc7619ca717078a09afafb91", + "f83f5339fbbb59939406f37a8053030f00333d809da78196e1dc177209fd0e70", + "9cfce61b0d63c05676d62a7dac8c1362d78e2e686d6a8b53c56094bb2014ab96", + "dd387d649e718c5d7cd9618fab6cf60bae452924f4e0b36b9b9ee9d4b9738ef8", + "b4e9704f8937686cd738c71fa7250b970fe64be89c75e36412cf4288e7911371", + "b2d3838be418d29c1ebf100d269591a89b6e74f81b822cff71d8a9d9548dea0c", + "e31733d8cd5174ecda373492fb9ed3f56fffdac8f869380c06ee9f185821918b", + "3c7b69a99d3765c95a713d27af4ac28d7808ca92543062610bdf24edd3643790", + "cd639186013fa4488043c42b05357e82425a3e889ac14679eef46b7388cecfd9", + "0ca04c8edcd2d8a247e575209a9e5c8a1cf86c39e6655d79d6f85ef41556ef71", + "d8cb785d9bcf0b1a8289362c5badd0db084f2efa3d831fdda8ffbc5cd423febb", + "c932a2fea0cf3a50a44090757e856ecaa4914e385b566787b60877f04c947002", + "1d3d7b3981fee634842a7dc05f5e4d1bac279c0ab8e9df78d768f43676186340", + "155e5683914f9d0fff0323548d9a531ed582e72414b934e57edb656579cb05e7", + "486352981492eeca9626588e8aa0a737dedf797d83a20148cf86aaca0e5cd660", + "692125735f88d08d8cec81e5564ed2f20d88422cb693407e8b569f2b1e07050c", + "b9195800d5bcce2e36a49a8f49f1674d9913dcb526cf50d1097ce4bea82407fe", + "92d25db73aef0c89d7f6d45a21f56bf7c0b3854a0c8d19db7bc7247ed2244f78", + "9eefbecbf32c98775e957013ff48c835781e52d91e576f81eec2c079bb61acd5", + "9a71eba84ef99ab18d46121f3d387888c2ebd4054b85f3cc2fe90f8e75cb6538", + "5fec8b431826e32ff8b6d3da66269f1e8561573bdbc8602f3fb20fd5e1bd8f44", + "117d803b171807fb6ea627fb8eadd75abcb20606fc3acfea76def5897a986f35", + "71a5b2e0b33d5bbb1ac73e6967b839cdfbea4de2fc828ec34ae8e40f8dfe96aa", + "3175ca255e0323924a203bf8aa949691546196277c5976052ff0678a934fbffa", + "7b355ea64f6dfd26a0ca7c433c31b1368e70d785f31c71caff4df6883245d409", + "3f00299f644f669c39db368d2a0df198f572ce9c8c08c85a94fd8c7db9cb5500", + "3e4b1620b66257264d51007170e6b0c49729b4731e3e1d236d188dc325ece52b", + "ef62a3e54636bc30ce5b75fb14e4753986000fed2eca3cb11aab716c88729f31", + "53635a42011bce8fec02af0d16ca0cf4b994332d1ce09551b99693a1ed59d247", + "0e4f65ec98ba41eedab3df06256eb227c558f31fee052a4266b3539f7af08275", + "23a5e489bbb5740c0c685591e6b73a7096bb238cad11e8d7e84fc9f4b7f55207", + "b92a8731fdc1bf7bd7bce4084892f87e4d9174acb204ee163cebebcfcae6a5d8", + "2e55a819e3b67123ec2edfc304418d7fee50dae9c9b922c3a5d250d6f7c9662e", + "3b6aa69186293835af4c700678ee9bb810de2ab8899c93cf245e01537742f5a1", + "2377ef08168881eba6f35e080a5fed4608aa733dc9670f59d45ceee5ce08fa47", + "2f26d70299414d84d00c95be2fd40758bce2e88a1fe89bedf898395894f501b9", + "5c2048320f765e1756e7a743afa544a602d648311f4bb8495f3d43de0f8cea49", + "e08780a749f547c02460053e2a258b64f89ad494c042171f2e8a426f3c9a0520", + "97ae7d3c4e6969d04821c5ed50c21a914379c1a1b3b5e5dfd38b26438e249f2f", + "6e181d25ef0f246585e55b5eb77c8e6191fb135af98e816b0abd841134bd5d57", + "271afe681be4d6c7c09cf9b4010888525eb1efb66cc2501215894c15e2898519", + "e8e670d05231f561f6a2ea1c1e08a560a96bb2674ac72851dc29da697ac169ca", + "8726ea1166fc378ce1bc6bc99ba52e93416fb5d1fefd812ea29de503077d548f", + "3cab3aa4cc41da609f367c1c57db872b8cfcb7b2f323516266bb3d8fa36642b4", + "c5a186e0f17d7af521efa20982916fc813e1b7d05295c3da7730ef6b5a48cab7", + "1738964f08db1fbe6b5965f7721be058d80a4e1ec976ac743059a5b31d6cd7a7", + "7f10a07aaba3a86425dce315a22df012363cd11065229f983530e2156fd77442", + "d97c168cb31e3390b66dc4f61020d70ef36ec9bdc679c2b64a79dfc648238207", + "0db0f54012e0427209e8a7b14f787419a4a6cf8cfbfd7e985e34898c1dcc3b5b", + "82d9cb547ff915752dd430f4b91c03970ed3cc9e376a93aafea77e196cd1998b", + "88f50df0343fa95532cb3b9d60cba5cee24c7e245bccc8ea06d8803d43f99f75", + "525d6f86a91046bc79ec5e19e21eeb42edb94aa9c1a3a6ff669455aebbefdea1", + "a8387bac47d88608c9a58ab2916857b9fc2fd8a1d52fc5d16f79bb4ab8be40e4", + "57ea90041e625ad5368caca533f024381987b1afd81d092b28eed73f0c8c5499", + "3eead9155ab4b5705fa08efb59ff16f1705d2eca4a8d707e4f633731bdccd8e5", + "e1d445eda8d84d9b3972b06b657c3be233a2c77a2cc146988c3d076b11b2f906", + "0e6a4376c4e70a27e5bd632511b761c70d8fe6776f93691d26262e169965152d", + "94df997fee522b612e12ed3596618cf27aa3a3109bb459f16eb6b6c136538295", + "6397f7955219931bf05a5b8407360c4b71ae62002aa273ed85db15276dcfb613", + "a3880c761ca9d0019b08cf255540fa495d5d69593e9bd73fa6eecb41dae42859", + "33e09133f59de09d87866389533ef005fc2c34de8a4cd68ea1d528d3c6df4165", + "58ca35a7300e2d7edd5acee6de464da5593d81380aff9e99fad2bd1d8c0dee68", + "2d8220d8b7f51f9f1082d903f592ff051faa4c37a46fc131c31da1dd2a233ed0", + "0148345468c538297511e912438b1ff6f0bcc70d8058f87ff70b5f944946395f", + "cebf3f7bf74150ce4fbddbc693fd6881a8d18aacbb54b8e33097580fb330e273", + "b8213e35bb6cffbddb211df8497d7c37f33a800f3a729846b041155c2f82c7d0", + "33c0d02c59cebf05005b834b6354b9d11184238c087a253b86e5479209a57d61", + "cfa8f4a6860419485b27245e5f66228003a0f4fce6797dc9e7fb5d938bb61100", + "633e780f4bf491dd0635d773334d7d2ca15a670d0d78681871dd88d77a2132e7", + "0b51f52c0d43beecb81fb62c82a17850a11aa6faab7527ea4833efffb0b4a8c4", + "c295b4b3d54eb3f602e5b7b6f302dd9c66cad44282af938a158887a4b64e6400", + "a9979735925dbdc75c01667c69443c96f645e530ca0fbb182c1d515093799d43", + "9fffb2f1348a76b735b269ce0961460b780c22882cf471ae5f1c1fafea3ae48f", + "d06f59868c9200c0d32396ee176a3260ba3940e0fef382b1edeb189030ab043a", + "44110d2cf36273a7c292ad5a9fc73bfa40d5de4b0188a8bd5d28f6439e078ef7", + "7fffb43180730947e0ce0f17899806d2998df9a70c9f9850a0bf0d5ab97da3f8", + "93b7d5e9121a06853fd8e0b65a846bf7497ec5c9e769db2f721ce40770a5ad8b", + "e3c15c181160b97750a748f9b1ef062574f0899d602333c7c543efe7be6687c6", + "483fc4310a9c5e101c6e1592299caba75d191c524516cf48094705cacaaffa1c", + "e24b115dc5e2bbaa03a956e316f036cd74f284a2170c98d0524b212839ded525", + "bc6e44c74a39e34b2763f04641908744dda340b8ee026c24e6ab18298230dd6f", + "646e8841bd52d5e6f441f08b068b8d3a1ef694e427bd418008dc08e55f9263d8", + "27010201141d9d2123b140bab4c05d1e60884510022f11e83aa5aefbb5fddc66", + "0a34d5ebaad9e855f386b3362d8dfc509d0ffca45877158261eee625e687aea6", + "ad133cc1b1af014f3acdb5852f7efde5750b39eaba1978bd391f0e620de02e54", + "210d474dcc58be7f5f81155c0b2135d26047b8bba3b413b2aa20485e4cce68fe", + "0158e2507ccb37e5302d3d188bb58ce6f7bfa56a8d84c1e2f085796719fc3b9b", + "2c4418eeb0fcf9317e8266ce1290919cf7785f09ec07efceee9c9eb31eb2c785", + "4b325afbc98d6f4510cc2e0bb3e957113ae4945b81d29caeee539c2da6f710e2", + "7d6fcd1860fa72512ef76e0187dc7af6fb467cfa2e96f9601e0e8989c38994c9", + "88260afe57f54f14752828d92501cd736bd27ff95389912283e88faa97a75269", + "529b7bf7e34de1f5689bba72a58407f3731bd2cee8af78a53dbd15497faf9d40", + "d5066d261ad12b1f8692fbfc1876a6d30837395cbb121351d9ba61cf1b20cea1", + "b0f968a432800d13c601c7520bb36cc9ba52b24e2a09109fecc34cbfecdbe9ea", + "f82bb8ca1a7fd8998886a8fe8f00084f108125394b9621c6cd19d92f23fd8c3d", + "53df3ed8b2dd7c46d8c42882a6096bccf1d6c966cbef8158b45f4390085a00c0", + "117aa85101fd69718713ffd12a7b4cbaa9bceb86cb52731e69ffb9ef83f80750", + "10662bded3a99140e896de3673635e5d946b0536db96643d0b4c621d7d68f56b", + "06b6066af41823461a0773a4018a93e9e7dcd71afd31331e5fa650b4fd1ac2ce", + "eca317877601cc31ae62fbd401aaae05a95ba092256beae0a69f90f42031dd40", + "040ab49439c03cee7663bd46349400cb389c480732f583aacabd8aa2281ac141", + "9d64998ae03ac69c2d6157548cf8f59eaf0ce08f10059bdf50ff8aae62dedfc8", + "104e0c71e792ced34e2811d7ec98f691d0740d260a8479c5e352e6d6185581ae", + "09d6c766aafeb3164a7a719920d7f9b871deaa9dc84691e8073f0db23975da39", + "40a86c0d81cb5654b51d4447a6e348a246decc7780581a9aa2d60c2f768e1de7", + "378243809750b9f1750d2d1f0f9204ca18d490e7458afff003f86c8cbb255dbc", + "90565ee1486201dcb600733c58934abb476fb873581c0e3dae8aff2ea1ebfe5b", + "f5dfb739730436eef0a9ed0f8c1c7b982469df5d6c042d321de52ace8d3a2c15", + "34c56c75a6772748996ada2bb9f2ed985d65a7c6de0087e220f45285846cbb73", + "42fad701f64b0f289a69aab6d432cf25ea365f4966a478216977ccbd5e25c19b", + "ebf4109ffcd719505b5871ad734ed07d7d1718a173977d31106050ae7bef2ff1", + "df543c94ec4b21c6fb74b805b76a1f3c855d222faa8599c060f8c85020e320f5", + "ce720073f337bb4893fa3a3b1e2f8e86696e5179617000f4f47cb343922ddd3f", + "786a19bb3612b1d1110134aefbe6968e75bb3340fe8d3994fcbd0e905bffc18c", + "256345974cd78d13520d2e43ca98d1ca0d650baf88aaa6b8db75c80e6505b101", + "2648c4f69b677c285297aca3107a6770c0a4bc1689dde13e6b5b59e8af91940b", + "752195dc0695f44531be939deb0f9940a9eb5273117c7705768c2b5edd6a70e5", + "1e4da8e8647caba2f3b358ddd5c25936b46d87b9e118935597be60fa58c6ca4a", + "5be16077f567b7bf0034e61bcfc0311887588c95ce57c0e2fb430dfeebb93736", + "ad205a52efc99c249042c9a2a85f6e39a89ca00a1bbbdac176bcbbd2f6ac6418", + "41414f5074402bc65ab7cede304c467ea56456ccc4d5a99f74dbf698ec80a014", + "f0a24dbc494b779606b3fae942042ebb6e42d77cf188d81f5e0895215f24d975", + "ed67e0034372067628553cac0f55d69935203f102d2eae5bccf3e9fd6f8bddee", + "1544c144771491cd8bb6c79ebb199070189032a209a17ae0f5df17d95e0a48e5", + "e2fdafc580819c643c0a89d3ee89d934d4131d06f288295e946b93824e098863", + "6b16af8419f1b67c3d8176c2e2b6adf5ad345d84c797d4621c883d12c5881eed", + "6101922fcf4599ad00260237e8b14904716156d58a25c638578de9775f6546c4", + "0211764bef038cb43a5c8b4e4e1c2189e29c63acc195a8f18f5f52abb6c2d896", + "9fdd3d266a5a068ee069bc4df1c9ad13f5dc11503fe9730fc069dce86d2d0cc5", + "501185fcc47f5bc79f11c17aeb48f6a069298e4538f48c2335f5a5cb18d3d4f7", + "9039f3d010b09f603ec640edceb7861a36dab4b82364c69a208040c3ede48f17", + "751f234599524ba682a48181293f9f24bbfded0b905db1400c4d66e287ae6470", + "c739f4bf1f227963dbdc0ba653351d9b1755ac4b30e4e1fc29a552d1763752c8", + "8e3b632fbec986c803e343ccfb4c8a13c03b04f6212cbe161efe5d5976eb71d1", + "1d20996dfd8ac9c5cd8de5ece58b61abc6e482999a720d8fc6cab8017adfde73", + "74468a7e1be2e9c78afffcbe10b6673e7522120d6679186fd21614fb8d3260fa", + "e47b686632ca64ef9e44b6da170481087bddae257940e54aeaf807b18edb4120", + "23f33513eef75806f25e55dfadf2e09727569c6c57dd020b686cef0c9a6e8324", + "8d59bb2bc1e8a2546b70e875ed5138dfab8f5209888877a7090294b3ba3e8adc", + "92bc28c793c6cf7200794bdbb5c3c821fa205ed1b4b06fcbda8d0124d28e3136", + "cc61018d326cd22a23b07c05db51cfb87618046132d4bedca206cdafa063a20a", + "b370ee273c4fcdb5bde8fb9ef6ddfd45406447ce19c748e418de854c2f0362e3", + "6152c270f83886cf3f5761812c6d8eece4cac8c348230c9b42dd271d1e3f1aba", + "2a9b0d00fb1eb5564fd96a8c1369f9f8e1d32b947cb59a334d47b32c6d963897", + "384c35175bd92ed2c097eebdfa72395a309acb7aa60c390ec3eb66773b661d6e", + "573e038e86e51ae46e5a7992fa652fb4b92632a7065260e12c46d1fd6effefb6", + "005be3a45b8fe905f0d1a63f1306ccc4eab8191d20f6f5a805f4754c20ef2daa", + "9a60982d54be5edfd5af1bd9f7d25dca0be74e77d5eeb6eaf37dcfe06cee188e", + "676257a1528797108e3a5fe031627338e9f09b44297e33aa1463cf46e5bf7db3", + "e7a241cb0337b1b02a56acabcd77baa1363feda4f01cda38d460822da991e3bf", + "7ac458257132ccc040a84b03c9fb7b9ca4fbe0579e7d3428f584da04b5b33527", + "cff2be050d602ec4623227bfe5d17c81c6b4da11e8c00ad7f7ca7d4c6acc878d", + "c07b292e4500a3ff9845bb55d6d69eae602d939e7681ae5d65effe80db4626b6", + "47136ecffbadd0a856d93adf53a2e2b675403386663bbe766bec37d313c87a10", + "eb1bacbee5fd2a2b50535a70ed300e93b90491d7d3d29d2f1f8bc5ecde0d7839", + "15e2db68968bb0000bda5bb3747451926355e9cd63db122bec12a53fb15da9e1", + "1ae6a3722ce9c193df69b1b8a37aa086ec323283628290f7298871676d3c4cba", + "65477882f5794c720233a98e1e383d91deb070f0c2bceb95a5efe7008f854cb5", + "2a630b24aeaeeef20baede1abed05cc9c45794561239f64c6bc291afb4b16120", + "70beda84b736a344f503b4e25e0e4a426f31d7041d283aab464026dfb9714457", + "591cd0ffc4b3b51cff8621ab1458a478c0a0f57305f0551e9e5396dbe8f7d349", + "53625b2b7fcffc9568152e6b6d95472fe850ed163ab341044a0754334cf22e34", + "5751606d1ed8891eae9bd10c5676a54ec196b36b00f9b7d3aa9ab0ab04b5cc25", + "f9f8ac5616f2d1864a6599bafb5f2e6bbc7fba72d6aa23d9ea1e0096de9d4164", + "56241bac3d18e635913ae9db5fac9cdde4e28d74795a1ca77227354d8d38fe1a", + "e01cbe3312394d636a19003923a0ff3eea7f8d2e1d6b42f94777655add3fe9ee", + "d08709244798a43e91f24367176899d90f8678813ec8b822163c67e1740f89c2", + "7571cf1e503d83dd0c915f69b8365e94a1b37aaf98a37d08d4b90e2a3675220f", + "f43f4e2cf5990ca47a833947b671586123e6e73a57d4305a9b813a8ed0d2fb8f", + "12bd6bd6659343e3dd9e6666572c55724a0a9e6990b890b556fe662db9d062e5", + "9ae85f24c4abea079e0223f9f05355dcaf5fbb396291c96d5c3b016099e84bbe", + "495097c042dc6319f9f6480ad049016f113b9c5cfc6d612e04aad56934b919eb", + "4eaa8cc1bf14b329db1097395c1a5ecd0f6fdf5a5de76db7f0339ab9b2c491e4", + "9d9f56a74cd94f45656c40e09823308aed0b4c9e745203cd5950138713026939", + "40797ecc115fee18a4608c9efa1ffeb81c2ee1c4842561ef61fcf7076f1ffedd", + "11cd767ae016d95635cbdfe08538b9347337d6b0847d12697075584b8d0619f1", + "71cb92eeba1ac9e0112a7cf621767729fb77eca209140f248c04f3ca1b0918f8", + "e44a0c43a95543503268b2378dfa0c9161c522c62bee65fa4f4a238875c64b7e", + "8715cacf99e5b7a106cda39fd2b6c96c2e5022974b0f66de7d6a15ed2aaf4eed", + "35bb68dde977abf2784e33d1bf3052893a358a43a8b258bea6a7318b1dd4a310", + "b5bb928fb28bf9699bfbabc626fc279a9ebd1ce6b63c993ddeda7b9eb2f8cf27", + "3fc619d1072c86c3df178b90349411bfed86c49dc777f030f2d27e3100394b00", + "05ede74d5dcb911b02053a895751f92ae86743298c8c6d8c5811de191cd4e5d0", + "18ad4372b90d74e60d68a00e4586b0767c060f9c522d2016c515cc5754eeb06b", + "595447850210071d76266dff3f9ceb530f5fbdf38c9940011abb9b96820f69d0", + "3c80c4cfbea01760facf853c328821cbfa9635adf55a650b92fc41bcfb19c8f5", + "e4feca4d382344176e8ac45592711e4472f76e0667867d469c65ccb5be2c7a19", + "7d0b37fb8ac67f6752e21869e57ed1d8b08be8517ca53ac2835cd2295df094ed", + "4af613e520506104185fc529b07037168b79165ec93e37331dd01f306307a9b7", + "103fa19cc7adb309027f4eafd56cee2c11875358bb4d8d8dd2bbc2f3fe698bb9", + "ede21fac9950f370f23f2a674f795bc7b2eea5c4609ee32fa64d4239218b3d98", + "5b6014bebeefd652030b6f79d14252c51a6f1159a2b37bccdcd3e515e0ae27b9", + "dda18f566e40a3b6e882b5f35ed04328ef8288094d8151bcad76a8c228454f6d", + "bb06814f937b8f4fd23622931286468bccb770a49112c94b23f06e97ffb7aa05", + "9c629de1ccf91a807ae4d7c296108a9ec7880c1cd278e0da344061d329755c14", + "6dbf2e32d098163480ab02a98344750fa5daafc7c66adf4fe90d0eaeeff4f86f", + "4e93b1d6b6d8ee75bf09aa1789933ef1248397e1e3df6ddf8af74eaa04d59c3c", + "6e8f38e9b80a674c58e2d85fb797e0357cd1414528a175f8e06a10b15455bc91", + "d397c5433f574c1a5f9d5c219c91131f3823694a50e04a6a2d896458b76f2e2d", + "f50cc41a1fbfe1a27916b010ce35aed4d7f2803e571225ea1382facd5a603139", + "f375dc182eb989bea2dfe5c2e26a351c3e2c2ea5c8f11447f34004c5c5ca2f27", + "7171793b9c6db5102f6088265373a7c57778f18f440380255a390d5745113652", + "494461bfc7dcc180d454bacd79e12b4a12598e3cf2594b4a96001188df71f27c", + "4ccf4da37de3d59a491675a6cddcc6323deb914a8f458fe6bbd20f4ab824fa69", + "74d21ad3cac9cec15832b98239679ab6360d84ae3d2a36a3f02307d647e7719c", + "b7b45314da2fe600d6377531a57acfd3f5d44c2f0e8641d67f0c9288bab8a3ea", + "7e9025449366165d1e1a7a84b15c89acdb7220595af59d776716b7caf76b517a" + ], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.606516609084792, + "build": 18.3, + "query": 0.0 + } + }, + { + "case_id": "nodegoat-benign", + "ranking_mode": "evidence", + "rank": null, + "rank_kind": "selected_question_position", + "selected": [], + "deferred": [ + "590ded4d9ba52b59e2934f3d461e45dfa5bd351f13c4fc17238297438fbf492f", + "33ab14574877d6a529a58df1926e358759fb4ee1ffbc68146aebf77a895c8eb9", + "489bf9f5f3a1e3771698cf111c0e7fa3e84f81848869c88a44cf3d19979d168c", + "ca3b943eb07fc11f6cc16228ae4e7813cfccac5dfe7ea9147deb0ce84677e486", + "a83d9fd2d4f399a40984cdc63e30003a73c98a6986f76fd5e22ed0ed7873c8b3", + "593c9114695f69035b4df9d566534e35fcfaa2d78a3e4362c2ff634580d6bee9", + "87ba1a35a429f850990db0eceda9996daf572b97b32b38e0f7ff4b80dec9a6b2", + "e9cf95baf8cef9a83d9da86e0bce276421ed404867ad948acc338fa759a3450a", + "431521d90fc22b7683173732598c39b94a25447f7403dcd4d9e17ca23e243a61", + "d331868f74b26a35872e8eeed4f66f3e34a29f8e9745fc14c1609cc3408aebeb", + "61b6ec72d6c0dddae427635aca3c97681a112cc4c5f8e4367d9f5864c6eb72b3", + "e831bbc3ab250e71270b1f5175756f39c2da662bffd68b2ed78b5389a4f23d0c", + "082910c464337b0041733c3c2733ad7947d71549180f9a0b8ad4172901469d02", + "14541cd08e0b036e4ab5caa442c01459fb03a6e3ef0388bcd0347b121effc6fc", + "da4abcaa22e13947dca90ac9156293bda9297423304d60d587569389742ce17a", + "29000feef9d494e003efdcbb6eab5410bc93ad2f4674df9db389ed98a9cfb242", + "4679cce5fa8da06bd1f9542b5a58321d2b090556cce83080b6e9ace36d352a59", + "df4a0610953efc25e4ddc4bc942688434be889411d073fab09015aba97ce2511", + "9b7910f9f96aa714b760481e46e543ea413d6e4763b858a3d0c186a560ad618c", + "298f3d69ca3e2b343c9cc5288680120b89e035bfae803dc6f6952358b6d0f1d3", + "7fbdc1e100a0b9078b6a2d6264bfaa596c64501b8c5ced1557b56a3d98e2b351", + "e4fe7eb3e5d57766a2c6adc79d46b9f57ac13ba11df7846cc4f7d62123a51bd4", + "0cc9059de118ef8da2ab45a3453bb2f64a679dfa33233f3b1b722b3858df789b", + "d561ce2e09d49013cacec011cf5dfa8c5f35c25c41085e856b3d5f28579ba6f4", + "7eb45f19bf15a2826d7aac45f36137de8824abfa9c0d5412da3c69c5d6da7a0d", + "ef130caaa2b3321cd12e2c8c39a27f9a868d2405e572fcafa5cab93900d9f97a", + "115b829e9b03431b06c12212efdcc2da02b5e22953e8a02243a8cd5a59cea0f4", + "db0e20f3ffa3b74105bddd565ba608daaea4cf9baba6b43a2539958e1a8be668", + "d2034c51a6d44b7b5cb553f2ad130441532b6be68cac0e829b74c4240aa642c4", + "1d7abc4a4a8c6023e1c5231f46167efdb6c476e4533ea4670a17ecc6c8d09c92", + "ba984e9deee4ab97a4211ce15915bc36e0e42907e21f40525be95c698c439653", + "ecc80bd3363347eac23b60a8ec50efe1a5defd3609aff7149022fac1e74524d4", + "7cead756038bdaf46936671d2311c93b391692337189bd9f3acb5711dcd1b594", + "d7044d436bcc3e7e313fb2baff364c8aecf980b28741afd4d020f858a47a3909", + "f0fb49041bdc02002b8aaf574a29a738aeb235ca0bc5cbbe9998dd9841e93a0d", + "f12e400682d1a222abca9d05f942a24394d7795eacc7ec322c585a0a6ffe69ec", + "5e24ba3194915f95a2452882fe928f834ed4740f8fa2087c7573b7c2f128a2ad", + "4d7554903c7ff3f7005fe4ed77f7e82af8cba218d3ac0b431acf14d18ffeb639", + "896720a23ec5b7da3163d53b517817cb01337cdad64d2104dbfdd3b3526f9c5f", + "e13de3ef10e25c529870483b67e47206b9cd32251e118f20f628eba95236d9c9", + "ac5ad3cda567527eb97dca35bb56d076292b88e20baa36d337967eb1f4f63dff", + "7c0bba65b77fc890e479add54e7fb0e9a7d145a4304d81f614536a8470d0a471", + "4ed8fe95db377770a47a2b3ad04a3a720ec21bdbd5222272ec5555130a627fbb", + "ece73e32fe91c87a001f1e41342e09378041ee876c8a8846a51347b8b607cc2f", + "8146eab0359ca0b822353b632ced69bf09fd449704cdf7c6f84440d7ca784cef", + "ec7c01083f1fcb35c35244172a005b3eabebff9c0fd1dcfb4372268f82fb3894", + "ca89f1fd26f88f845f394fce84527e83c6a4cc8252f30d6787e7c5ac13e119a9", + "c3b4d527dc5c4ed121a487d5e4e3aa868df773ef3b04200802f9a306bf67c730", + "9e5735029a42e23af56c2cc802655bf46c55bfebf19f19810ac16cfa15fc688c", + "a562474ca19fd4d4ec052396b656b092e82be7b1c002746f631cd9fb68b39ff3", + "22e26415a3768b1b12cfb9469b912d359d0804761ee7f1d02d281600373dc8a4", + "03548d772fd2a4030a9f595257333eb9b323f1057a2a0399ed15efea113e719d", + "0f5f635e19864fbd276fd3eb0b6460f86274e6bc52533594879fcc42c02e4df5", + "f95e55b8ae987f7c4b11837ddaa8dac8bed46541f6d8c12633b46fe915b41824", + "e77b04a213011bc3e9812f81c2d1266be1234ff91a72d347b71017e8ea09f4e4", + "f7ab6f0b570873d6b99c3fc33ab556f093d7f5e4991eac884d3e766a2c29b326", + "722bfc188cadc50c1485cf4ede13f2b62e93b08b16f42f2586c104b8bd3745e7", + "144c1db7c40aa0a420e02130a756c7793fc8fa5d33549a08c236ddb96bad2df3", + "6bb3ba6475ce8d11ff20924b69721387bb0d4bbce1b852e640403dbd750f0a8f", + "a08e3f98d65d0452a631a11de0ef53c9fb53492efcf3d8003b5512478b92b4bc", + "4e0e78390504d44716e20ff65cf5f16c1f1ddc2fa0441e503dcae1826c666529", + "0e143029eb9d5d5c30c3dc0fda147c852e68d4e8d407795a1047beb586723238", + "43e8934e37c9ecda6c36b4bee6af63f4269e59cefb5df30af45ae08bd93f5063", + "6ad6e59fa1a92132e095463bdbb461598c80b45af85ff453a6450b59b61d10cc", + "c2b3c06e92fa87731137f871b9dd0f867fc53156a80bbf00da955cf5bfe0fe7e", + "b7b9b9cb1194740a47fa214266a43fdb70019fa1308009589d38f2c7662aa4b3", + "4d3ed9000a9b5806a0ed641e2739166e3df18ffa1925ee396fbe25d29e332c71", + "bce9e3fb76d6276772f1f279260ddb2f673a4a45a08f13fbc75343d20c0ad4ad", + "f0aa35455461c8f75dd8ca533e03dd43ea339a7026f07407ef26b12c3fe6f44a", + "64c0f7e52fb34476d5e47478ff354845a776dd781a2044963cae3191bb18058b", + "9f9eb159649a2e07879e36c4f5eb5bbb38e337540c4b295adb4b59ca31e2a868", + "bfba8296d9252a696a7f8262a80b63019fd89fb866e3d3daab087101c9d7ebd2", + "6b6bc1f8b05dab47833d180de1fc7b40d8637a213c87af02f19bfac2f9439869", + "72261efc87c3f66bd420e106d6e04235b2d6a7b4c59ceb5a235dbfbf31d02f29", + "94e30a15524e236d04ae2f0238a72c0b446a48b7b4302471ad6703861948025a", + "fa59397c0eb909b5b269278b706ba8432004d786cc8431db1e27fdf9614211bf", + "a65d452c03e7a0e7bfc77d9337f0c3f6cc47449979963ca1173f45c619b7b812", + "135f8cdcca313308bc5456466706c561652768149ff61e93f241b383c07448e8", + "d029880ad27458bf1d443088b6afe399af206a9f412fd8406769198f304e64f5", + "2ae591e30078f1e045b446004067a4734acda37a9673dbac82bca972cb5f8c2b", + "b35cc9123b9c6316f72cdbfcd7945157215622625141e56543a4093c0c553013", + "c8d88ff3a98aaa4eba3756a5f0b89cdeeeda10e5180f5eee0d3ae2b7dd042cdb", + "f06f0c86aa4079e5d3ac48ffa9b50661a0bd2f4c315190b26f13664de494c9d9", + "627afe91ac03ff52d178f64eb23d372523f86fb34fcc0ca0dade6786c38f0dbc", + "ccab701536e7f9615e52f4b1a1c68a2416263ad8de279372ce248fed5d7868ed", + "bb71e211e99f3dbe040a15b22eb7e004da953ca61b700ca3d1c94764cb6bb80f", + "d799a15d3d810c39c4a519c59843bbb6c2617f559f8ebdefe801296e0819149a", + "d6a24a60b3cec846b01cb2c3a1535ee2ab834a09e935abe70ede278ecb1ef045", + "d1cae428bb382d9cc38acac1c7bb8a5e6142a46f5b0e6e2ddb1609b0acc66f68", + "c46c90f66921363f974dcf82aaf3b3410222ec081abe097417dd1a1accb372b4", + "5630ea72ee47272cdf5f9e3d1df3aeb499c357880ad49b26cff1cebcbbaaaeed", + "013a84070826e011c0b19953b3493276e98498b3837618303aff28475b38eb2c", + "c158a154e2b9394ee661d2f982e93af8d59543bb7da5c8d2c8e9c65905384d4a", + "a0423c87fb8581f1897c9a0c774c3881ba8775e05f6cd88408cee05d126ac52a", + "7e9c5dc7bc705ee6825fcebe23ba885a4be30b318195ec89e9a19b450bff86fb", + "c6c5a131a84fabe329dc50128240b463b18a4ea0af2d036bcc02d869ec57fa7b", + "ffe9fe5d19fd7233e88869bdd2f6fe00785a9b15d074a3f8b171a03121ba64b0", + "324cdf414ea58e6d9496c28b138b43bb18cd6e983fb7678aef960670a51dc93c", + "fb3bd242d8f9801589ca53c24a1b36b88ee1e6b8932ddb6a5d3bb7b3019556be", + "5784aa43502be5cfa00e65ed1800bc86cea1b83db7b99737a92e3059c0aedb51", + "e05d1e4da035294fb1b5185492276e323b43a33c173dd05390edee2726f82f60", + "480a6f9e635cdb839e9ed2fab13d22291dff3c92ae99e1bf514439b370480f24", + "acc5d491964faf3f4858dce3bfe338199f9b5469c1ad33e64c2f0bfad2f0263e", + "e14724d931f179f9298c723043307a99153207ec425d4fae28f78becba7c0a9f", + "756d4aea97736b83d6904a6d96d22e8026d24796d64d6806c2fcc478272c16bc", + "8fc292a32ac35211b4747151ed7797cdcc9cf7edca0ea697f9cd9ca9eb2bf906", + "0434560a038fb3a29aaeae6531b7190a9a993f75cebecbde4dbc5d9f248c16b9", + "5c7e3540a665e15247dc85c88bc06f2514da2cd85010ec820cc53548ac751009", + "074e2d12c8900202ecd6b02df395375ee6343d1c04c22982c214e74d38fdf51f", + "cf2f20c22b8acc270d75b060b45b3725d2a4a0bc4dc33adc9feeec336fa84f31", + "bb67a42d62cb5389aeb41a0e18d26046ab4f20feae70cba114ddffd5995ac3e8", + "ad9733cd531deb592afd4650ebd20d8c967ea49693d2954151a70f4a4edb68df", + "572f510d0485395c2ff610cd031d238c3745f79fe98a8f9fef5b042c24e57b69", + "0ae9ac017e10c4d6256d41b99b5e771d7e8acf05bc1087acb58148a8ea2e8c5b", + "691315c9798b266ce8aaff0a6368a80e40c685c1a8e3a54fe139131f4d6da7a7", + "aee4c8330dd8ef28010fdaf243964d48dec427871626422da8d915843534755b", + "57aa82c0185ff3d73d91dfcbc6bae9b5d438cf064ed0ea9489d6b5de7c3df531", + "79ed0c8a9f7d6b06e75ef023d6ca5a32416a9c8fbd5a75fd97ea1c0e8f7a5a30", + "23f9afb28b6b7349cbf502c2a6a1ffff117d2b3a974d8705b99fc8717108627b", + "a6f0fe4aec662565f32d93874690023ebe09aea9a887b330e0c64a18e41dc966", + "aa5a287a1749ab0ab4e4b56048c738b95df8f4b19a82378847a39ccb5eb42315", + "09dff44163511e71b0fbf539655ece1940bd80039bc8743cc922699a37340b71", + "567b6eaa4c3dabaccdfb44885a6a4cd345ce3ffc6a201265084c1818c0b84226", + "881e7f1a45e2d7ebf74842b131573da24478db0c44ddaea50ca20007994387c0", + "e9a98c513dc38db66988ce7ed9fe730df4ba5297f2495c77a54ad2aa9195b9e6", + "f7484f28717752c36583df6d2167f9861bbf8368ac7f18b8a7c41ed41f301f37", + "c0c4a04d19b7a5f1f33fff97f49a9d0245c4b14d24c3691cefbf46b76c064d7e", + "2b86fe6715dd628b59d2303d2939369a6ebff338e7c9a3f41a5e76371e70d56b", + "3663dbf64c23ffed29746c390953bb4c54f0f3154cc9fa65e7bf6acdf7249702", + "8beedef6ba5098ea3567e7e9dd3ff36fa7ccf418f7a8dabc5cd1c8df83ac946e", + "07ee5dd2f228e5d605f204a0e607fde140b169321c49486f64ef0ef3498defed", + "34ca592cc7c4769ab6ab180436ace3d801b26463a0915b253459fbe8aacc7ce3", + "2ee6a26bbed8f2554b909b310e8fbcafea825d9016c009fa785f34121053ae17", + "6dd70277e9e05c3828bec89c4cc94f2b256eef50554fe78b7bc7805ba0c77d7d", + "448a4023be7987eb4282a5534d6369f7e8ded7ddb3cc29c537a4e09ded04434a", + "338e654fb02855abf17360c328f02986bf949d898b489ea7b9b29ce090fd1eeb", + "bbd12c331fb019e0c84c5629c0b4945609328a196e3862f6f6dbadba31da81c9", + "06ea156efb68bae0ec77525ddbd4eb18c1c97512cf524cdd7661286b48a2684a", + "163b26e0bcc1ebc83d620624356e8a535ba4a3130af719e57a4dad9922d0ca1c", + "ef7c18370144ac600fa593af56a8a849f7070b91261415e8e3cad6bcdadc80da", + "f196cd68d51074be3989e323fc62287af695b781697b91b658003c825b426ce6", + "a763fb136aa3978b7f47acb90aae2c6bb5715e8ca5ef1088d7856608c8807071", + "5bdc9a08c76139479780eda09106fbec03bd5662c1817f14c0893abe4c22c798", + "4d34d526ba5ee10314a8f6a74f7fedddbcf0ca79986c20a5127dbb08acfd6c43", + "2c2899bd893f9611640844c56b404e5b91768151cb862ff497bb823c505d568a", + "be30cb63922297543ed6c72314d3b6ec3d849d3c5d28fc3590ad44ebd82c4f0e", + "28f1d0d25c8654cd762a439d6eb6f3a6896d37071f406d8edeeb4c20adee20ce", + "f6a81369acf1c84e3cd6bf3399289323cb47848984a8c96800c0682fc1055a04", + "94b9c4a91bfce96cbe773c203dfdf22d1b015231e91dd478399c2586be6a3e77", + "526ce466755c525287df1a2adbdbdf566c896d79150b9bc7dbe65936e83abb30", + "57dcaf9ddb9d8b054aa5dda6a0c9739439362e898cdf22aaf9f7338149f8cbd7", + "064ff0d84035d834f9382eb8b4ad901fbeb4aa9fe816d7c36a34d56af41817bd", + "d97343cdd389cd2ed9d0f1358d2bbddc2752053d95eab3e16e99423298a4371f", + "f9deb31f0f9b98cad69111389734d43ed4fa86f24b05c9f2d48a78ea7a8708a3", + "f962a89d04810a6c57abde4a8d3182d2a31c5d0f0ed3c37c053abea1fa223f31", + "b62ac1b4b282eadf241f508bd5769bdd440b274f967d6ca73cb685ca249bd287", + "57840b0da13c3f6f67e587689ab1eac913c17e91d493d1ce9ff089e8dccdfd29", + "e3d1ce3b9de0fc9b48f2432d5e64947b5b24c3acaf1166f746bff1c54a028b9b", + "d322db4b50c2c1bdbe0e22ef291070e20c93e0f7199c184f5ff8b4795b55cbe9", + "88371d1acc9bc3b69c1d1957b27c9aefa3835be37bba74a359c35b1beaddc2f7", + "3486da81fc55b7e285f23e85f44c481d780090285a384cfedaefa27265a236a8", + "c87588b38d18fe9a5c563e2ae8d79649ce699607a891bd41b68194ce4507137d", + "d6e3d356d491e5f3dbaca74cf11aef9bd751b36737feb34e466b707156b0d779", + "843197ad039bb4e840b949b0ed1e5cf2230829366646a92ffc53d63e26149867", + "b0766042c55d7c370799af987bed01fed8a417f83bc67e21d1366988aa1af10e", + "b788ba22bd4225c24f95821dbf1f467dc2b13c7615b0bd2b00c3b234b7519539", + "91430345496348280d29d11662aeb6048fd7596fc6304380b6154494df30d154", + "8c1be7b4e8fd13181be0c4e46350a2f972e24acd13427e71c15e60dade41c28d", + "f87a9ae1d7dc81f88c5891890b889aa7212e172ddec092182b7de6f01e787d7a", + "b6a42fb01b464f31f65ebc10fbc12fccb051d8b44cac51a6818d3aedabea07f9", + "4a820a780053b6f65492691e067e236adbd2a05b467e4e3f2ed37ba1260ce84f", + "b07131192ab22510055930477ced5a10698278b2e00e3f711ebc202db640bee4", + "5fbb00d9b2952ae4f0fed217bf2d8603872d8fc93073d99f31d8815539121987", + "0bd48e207e95be86ea4e459c090a75c0adac8ca31bd2b631043854551b2c4392", + "b11de5874aa62f939e383179c3ea1b34d3569ec6ade901964393b92f8325ad11", + "8cd692618bec00fbbf099d570561201a2d0fdb601050fd20e198ead478530675", + "19345b5fb5cecfc86e4db3cb8715cc7370e81796d70f11ba150a13c5ea8e4c37", + "3ad0b3549b82f93ad869a9341397d394c1acee5e18d94a699b118094dd7a9a70", + "32220b1bfe511b9dcec64d7ea8f4317e96b2d0cdc10bcfa55cfa3b63ce64aab6", + "0cca9d955282f37dd60e764c56b52cbad90b33ec2c2943a7e5d155d35b0417fa", + "40d00274aa5b28039b0d57d75a81f174c0a31e4be2d324ba79a64b79efd4e411", + "319d00690097314e26638e2f4a6d848f50d1ff2f9d6f755a618eb31398ed373a", + "dfa47fe83d195de69774c841747f6e7ea78d6d91297821dc9b8ee5fc625cfe2b", + "5a497ad4d83218c29d4f22781a54d9e1927dc414f7cba6f89d794ed047f8b245", + "1bd3f2289cc1bfa889496ca5074991941263703a2517281734f33d0ef1050f1a", + "587a689c0312ac0f6d98de7495f01f34428cb128e73875a71508f7d5874415b4", + "fc77f013f48b454d8703f25f76646f74b74c9e4f8e5d542bc5f48d98c6e51fae", + "a2a7af80da34233233ec619dc29366b40a9e55ead63626db185524f2415761f5", + "f180a77f032bfea9c7d152438ba830f19e1bfc88481a56b9e554c61d2cd64f6e", + "cb70e9a1b44fa1f13f3bcc5290e6db5c8d6eda83602c9513e91e779ac6cddd3f", + "74f543e29e519871aabcedb9d39c953d5397aac456c3c5e6eb0e10e517989eb3", + "c983c339bc6881a1e6a0b2c6a794de858613b91318205a623dc61d80c2238036", + "97c5314218bfb458e1fb6d1a33c9ac75c7de152774a736f6c5874657515ccfcb", + "0744dea5a54614d094a6eb711ff7df94a180bfdeacaf330e31d9466cd51aeda2", + "06dc1ba86d3fcb46096bed80d9c5c558f79a5a33f4fcdb379f1567b1271b64ab", + "aa48541c8cce586b7a8c5e8ebe3cb607d1c283ef8940b7d4c7fb584327dd177f", + "a9d086126128de76e0bafc06ca465176ed2884cb7ec963457fe106346b8094f9", + "637323a350346cee17c66cda9b8b1be49d58350b0a0904bd61e5af20ce611df5", + "aa25524f30b8e84ef80b52064a75ca56cf438e67e2696e360d683c03e85c4c6f", + "9b5371eadea2bf5707f730896b4766a8b56012269f1c02c5df9d0df1d1cbf696", + "d527de43dc2dfdb271c213a927ab31c08b1f063298b211b6b11831a4dff51922", + "5ee4f0b0ba2c39e7071bba12da912c1ae213b8a2cee0bb437afa500328a237d4", + "43d3388ae21433a62d37d4c92861c125683f03a0edd9d1afaa56a42a7b793dc1", + "cc8161804d4c84fe4c4f7210a16193637accc1f791b7fc7be026c07177b7da4c", + "4bc68b77bfd52e96e8db4fb7293a6d4f396d234eb4dafb625df76bc8f1ba1c7d", + "a66e57d86751f21d11652bc991ffe476eacb638f38f95947b723ac9448c5f668", + "278e2e9a97727da969f8d122576dd475c43141146f984e3af997600a013f19bf", + "3152613ac0763b809bc99a50b728391cfe19d2cfeb27ff47a1e3671ed7526a3f", + "06168cf4f7850405f47bd8cfe013dc077b51457b355698ea3407f998cb561c2b", + "44620fe943880d4498587b283cf31a67b85fdeef53f59223299018c3666ae32b", + "eaa4fc381ad8dd4a49b66bbe7ccb050b2ed8735ec0d5eaee4f555fce0ff39a8c", + "68a35789d8aa7b4f5293eb06988118bf39be4f0354e6dd89674da130c4ff7911", + "3c9cfda0c903ea8e97a9bdc2966dff555df6580479782ced9ea934837e3bdb5c", + "4367699c5a75ef7a22a52ca8d1b77e15ae6c8c18b2ec5fa929d688281ff34edb", + "f020689fd3ee8e3f51d12f177d80fb80aba8d3435a9f58e63cf4caadc02eca10", + "06f7107e12e2f2c7151d2c38ca31adcd8690e7dcab4537b37183561a9306208c", + "2f8516c90c01cfb4bd29a3b8ad1b61280436a37804b24929327cb41d8eac39aa", + "8f51fe6438299d6f935f48d1d0991270ad477174195aff8574ef587a45038efb", + "8d26ec62881cf7efa89509047c178e7b920a87cc4bfb9cb0d6d991e87ca22124", + "ec5cd96c01771e651d9e09445c5df8af453e475da75f47a583a1006e99686b09", + "2981a228c15eb8a02d051bad6ce39736dd5f4c3f63a979d997bc23086105cbaa", + "7055c8f3c6f41ee3593da37fd92332c561907e07a633b9ba7bf66347cdccb378", + "68b25a8b5bcd76f92ed9473318e67e752b5898eb6b34c4a1205b77a88dc0214b", + "435b8c03368213b50237bb6f7a4dbfad4e7ba8d4f3948b046a5e95ff38c739be", + "f553b646e7933b5f766d1187c3bb1aee241ea0734ec1c6addc08871c43bb7c64", + "5f7e12488b0d469ffbaa32d1fa766352c8672ccd9e81f503480cec626d1f88b3", + "86fed64323e502425165fd4b319a848da156ed4e1acbec6ac706b8f5afbdc1e9", + "3273da703327df23094325bf9a120c3bbbc9388b4bbbec32a24b768f4d02669a", + "cd57f10c8a3c69b40ea2832dc35837d8a7521f2a17b2936eccaab7d5bf482dd5", + "fe62a9ab0e66c65344f94de1006ed30505bca06dcc7619ca717078a09afafb91", + "f83f5339fbbb59939406f37a8053030f00333d809da78196e1dc177209fd0e70", + "9cfce61b0d63c05676d62a7dac8c1362d78e2e686d6a8b53c56094bb2014ab96", + "dd387d649e718c5d7cd9618fab6cf60bae452924f4e0b36b9b9ee9d4b9738ef8", + "b4e9704f8937686cd738c71fa7250b970fe64be89c75e36412cf4288e7911371", + "b2d3838be418d29c1ebf100d269591a89b6e74f81b822cff71d8a9d9548dea0c", + "e31733d8cd5174ecda373492fb9ed3f56fffdac8f869380c06ee9f185821918b", + "3c7b69a99d3765c95a713d27af4ac28d7808ca92543062610bdf24edd3643790", + "cd639186013fa4488043c42b05357e82425a3e889ac14679eef46b7388cecfd9", + "0ca04c8edcd2d8a247e575209a9e5c8a1cf86c39e6655d79d6f85ef41556ef71", + "d8cb785d9bcf0b1a8289362c5badd0db084f2efa3d831fdda8ffbc5cd423febb", + "c932a2fea0cf3a50a44090757e856ecaa4914e385b566787b60877f04c947002", + "1d3d7b3981fee634842a7dc05f5e4d1bac279c0ab8e9df78d768f43676186340", + "155e5683914f9d0fff0323548d9a531ed582e72414b934e57edb656579cb05e7", + "486352981492eeca9626588e8aa0a737dedf797d83a20148cf86aaca0e5cd660", + "692125735f88d08d8cec81e5564ed2f20d88422cb693407e8b569f2b1e07050c", + "b9195800d5bcce2e36a49a8f49f1674d9913dcb526cf50d1097ce4bea82407fe", + "92d25db73aef0c89d7f6d45a21f56bf7c0b3854a0c8d19db7bc7247ed2244f78", + "9eefbecbf32c98775e957013ff48c835781e52d91e576f81eec2c079bb61acd5", + "9a71eba84ef99ab18d46121f3d387888c2ebd4054b85f3cc2fe90f8e75cb6538", + "5fec8b431826e32ff8b6d3da66269f1e8561573bdbc8602f3fb20fd5e1bd8f44", + "117d803b171807fb6ea627fb8eadd75abcb20606fc3acfea76def5897a986f35", + "71a5b2e0b33d5bbb1ac73e6967b839cdfbea4de2fc828ec34ae8e40f8dfe96aa", + "3175ca255e0323924a203bf8aa949691546196277c5976052ff0678a934fbffa", + "7b355ea64f6dfd26a0ca7c433c31b1368e70d785f31c71caff4df6883245d409", + "3f00299f644f669c39db368d2a0df198f572ce9c8c08c85a94fd8c7db9cb5500", + "3e4b1620b66257264d51007170e6b0c49729b4731e3e1d236d188dc325ece52b", + "ef62a3e54636bc30ce5b75fb14e4753986000fed2eca3cb11aab716c88729f31", + "53635a42011bce8fec02af0d16ca0cf4b994332d1ce09551b99693a1ed59d247", + "0e4f65ec98ba41eedab3df06256eb227c558f31fee052a4266b3539f7af08275", + "23a5e489bbb5740c0c685591e6b73a7096bb238cad11e8d7e84fc9f4b7f55207", + "b92a8731fdc1bf7bd7bce4084892f87e4d9174acb204ee163cebebcfcae6a5d8", + "2e55a819e3b67123ec2edfc304418d7fee50dae9c9b922c3a5d250d6f7c9662e", + "3b6aa69186293835af4c700678ee9bb810de2ab8899c93cf245e01537742f5a1", + "2377ef08168881eba6f35e080a5fed4608aa733dc9670f59d45ceee5ce08fa47", + "2f26d70299414d84d00c95be2fd40758bce2e88a1fe89bedf898395894f501b9", + "5c2048320f765e1756e7a743afa544a602d648311f4bb8495f3d43de0f8cea49", + "e08780a749f547c02460053e2a258b64f89ad494c042171f2e8a426f3c9a0520", + "97ae7d3c4e6969d04821c5ed50c21a914379c1a1b3b5e5dfd38b26438e249f2f", + "6e181d25ef0f246585e55b5eb77c8e6191fb135af98e816b0abd841134bd5d57", + "271afe681be4d6c7c09cf9b4010888525eb1efb66cc2501215894c15e2898519", + "e8e670d05231f561f6a2ea1c1e08a560a96bb2674ac72851dc29da697ac169ca", + "8726ea1166fc378ce1bc6bc99ba52e93416fb5d1fefd812ea29de503077d548f", + "3cab3aa4cc41da609f367c1c57db872b8cfcb7b2f323516266bb3d8fa36642b4", + "c5a186e0f17d7af521efa20982916fc813e1b7d05295c3da7730ef6b5a48cab7", + "1738964f08db1fbe6b5965f7721be058d80a4e1ec976ac743059a5b31d6cd7a7", + "7f10a07aaba3a86425dce315a22df012363cd11065229f983530e2156fd77442", + "d97c168cb31e3390b66dc4f61020d70ef36ec9bdc679c2b64a79dfc648238207", + "0db0f54012e0427209e8a7b14f787419a4a6cf8cfbfd7e985e34898c1dcc3b5b", + "82d9cb547ff915752dd430f4b91c03970ed3cc9e376a93aafea77e196cd1998b", + "88f50df0343fa95532cb3b9d60cba5cee24c7e245bccc8ea06d8803d43f99f75", + "525d6f86a91046bc79ec5e19e21eeb42edb94aa9c1a3a6ff669455aebbefdea1", + "a8387bac47d88608c9a58ab2916857b9fc2fd8a1d52fc5d16f79bb4ab8be40e4", + "57ea90041e625ad5368caca533f024381987b1afd81d092b28eed73f0c8c5499", + "3eead9155ab4b5705fa08efb59ff16f1705d2eca4a8d707e4f633731bdccd8e5", + "e1d445eda8d84d9b3972b06b657c3be233a2c77a2cc146988c3d076b11b2f906", + "0e6a4376c4e70a27e5bd632511b761c70d8fe6776f93691d26262e169965152d", + "94df997fee522b612e12ed3596618cf27aa3a3109bb459f16eb6b6c136538295", + "6397f7955219931bf05a5b8407360c4b71ae62002aa273ed85db15276dcfb613", + "a3880c761ca9d0019b08cf255540fa495d5d69593e9bd73fa6eecb41dae42859", + "33e09133f59de09d87866389533ef005fc2c34de8a4cd68ea1d528d3c6df4165", + "58ca35a7300e2d7edd5acee6de464da5593d81380aff9e99fad2bd1d8c0dee68", + "2d8220d8b7f51f9f1082d903f592ff051faa4c37a46fc131c31da1dd2a233ed0", + "0148345468c538297511e912438b1ff6f0bcc70d8058f87ff70b5f944946395f", + "cebf3f7bf74150ce4fbddbc693fd6881a8d18aacbb54b8e33097580fb330e273", + "b8213e35bb6cffbddb211df8497d7c37f33a800f3a729846b041155c2f82c7d0", + "33c0d02c59cebf05005b834b6354b9d11184238c087a253b86e5479209a57d61", + "cfa8f4a6860419485b27245e5f66228003a0f4fce6797dc9e7fb5d938bb61100", + "633e780f4bf491dd0635d773334d7d2ca15a670d0d78681871dd88d77a2132e7", + "0b51f52c0d43beecb81fb62c82a17850a11aa6faab7527ea4833efffb0b4a8c4", + "c295b4b3d54eb3f602e5b7b6f302dd9c66cad44282af938a158887a4b64e6400", + "a9979735925dbdc75c01667c69443c96f645e530ca0fbb182c1d515093799d43", + "9fffb2f1348a76b735b269ce0961460b780c22882cf471ae5f1c1fafea3ae48f", + "d06f59868c9200c0d32396ee176a3260ba3940e0fef382b1edeb189030ab043a", + "44110d2cf36273a7c292ad5a9fc73bfa40d5de4b0188a8bd5d28f6439e078ef7", + "7fffb43180730947e0ce0f17899806d2998df9a70c9f9850a0bf0d5ab97da3f8", + "93b7d5e9121a06853fd8e0b65a846bf7497ec5c9e769db2f721ce40770a5ad8b", + "e3c15c181160b97750a748f9b1ef062574f0899d602333c7c543efe7be6687c6", + "483fc4310a9c5e101c6e1592299caba75d191c524516cf48094705cacaaffa1c", + "e24b115dc5e2bbaa03a956e316f036cd74f284a2170c98d0524b212839ded525", + "bc6e44c74a39e34b2763f04641908744dda340b8ee026c24e6ab18298230dd6f", + "646e8841bd52d5e6f441f08b068b8d3a1ef694e427bd418008dc08e55f9263d8", + "27010201141d9d2123b140bab4c05d1e60884510022f11e83aa5aefbb5fddc66", + "0a34d5ebaad9e855f386b3362d8dfc509d0ffca45877158261eee625e687aea6", + "ad133cc1b1af014f3acdb5852f7efde5750b39eaba1978bd391f0e620de02e54", + "210d474dcc58be7f5f81155c0b2135d26047b8bba3b413b2aa20485e4cce68fe", + "0158e2507ccb37e5302d3d188bb58ce6f7bfa56a8d84c1e2f085796719fc3b9b", + "2c4418eeb0fcf9317e8266ce1290919cf7785f09ec07efceee9c9eb31eb2c785", + "4b325afbc98d6f4510cc2e0bb3e957113ae4945b81d29caeee539c2da6f710e2", + "7d6fcd1860fa72512ef76e0187dc7af6fb467cfa2e96f9601e0e8989c38994c9", + "88260afe57f54f14752828d92501cd736bd27ff95389912283e88faa97a75269", + "529b7bf7e34de1f5689bba72a58407f3731bd2cee8af78a53dbd15497faf9d40", + "d5066d261ad12b1f8692fbfc1876a6d30837395cbb121351d9ba61cf1b20cea1", + "b0f968a432800d13c601c7520bb36cc9ba52b24e2a09109fecc34cbfecdbe9ea", + "f82bb8ca1a7fd8998886a8fe8f00084f108125394b9621c6cd19d92f23fd8c3d", + "53df3ed8b2dd7c46d8c42882a6096bccf1d6c966cbef8158b45f4390085a00c0", + "117aa85101fd69718713ffd12a7b4cbaa9bceb86cb52731e69ffb9ef83f80750", + "10662bded3a99140e896de3673635e5d946b0536db96643d0b4c621d7d68f56b", + "06b6066af41823461a0773a4018a93e9e7dcd71afd31331e5fa650b4fd1ac2ce", + "eca317877601cc31ae62fbd401aaae05a95ba092256beae0a69f90f42031dd40", + "040ab49439c03cee7663bd46349400cb389c480732f583aacabd8aa2281ac141", + "9d64998ae03ac69c2d6157548cf8f59eaf0ce08f10059bdf50ff8aae62dedfc8", + "104e0c71e792ced34e2811d7ec98f691d0740d260a8479c5e352e6d6185581ae", + "09d6c766aafeb3164a7a719920d7f9b871deaa9dc84691e8073f0db23975da39", + "40a86c0d81cb5654b51d4447a6e348a246decc7780581a9aa2d60c2f768e1de7", + "378243809750b9f1750d2d1f0f9204ca18d490e7458afff003f86c8cbb255dbc", + "90565ee1486201dcb600733c58934abb476fb873581c0e3dae8aff2ea1ebfe5b", + "f5dfb739730436eef0a9ed0f8c1c7b982469df5d6c042d321de52ace8d3a2c15", + "34c56c75a6772748996ada2bb9f2ed985d65a7c6de0087e220f45285846cbb73", + "42fad701f64b0f289a69aab6d432cf25ea365f4966a478216977ccbd5e25c19b", + "ebf4109ffcd719505b5871ad734ed07d7d1718a173977d31106050ae7bef2ff1", + "df543c94ec4b21c6fb74b805b76a1f3c855d222faa8599c060f8c85020e320f5", + "ce720073f337bb4893fa3a3b1e2f8e86696e5179617000f4f47cb343922ddd3f", + "786a19bb3612b1d1110134aefbe6968e75bb3340fe8d3994fcbd0e905bffc18c", + "256345974cd78d13520d2e43ca98d1ca0d650baf88aaa6b8db75c80e6505b101", + "2648c4f69b677c285297aca3107a6770c0a4bc1689dde13e6b5b59e8af91940b", + "752195dc0695f44531be939deb0f9940a9eb5273117c7705768c2b5edd6a70e5", + "1e4da8e8647caba2f3b358ddd5c25936b46d87b9e118935597be60fa58c6ca4a", + "5be16077f567b7bf0034e61bcfc0311887588c95ce57c0e2fb430dfeebb93736", + "ad205a52efc99c249042c9a2a85f6e39a89ca00a1bbbdac176bcbbd2f6ac6418", + "41414f5074402bc65ab7cede304c467ea56456ccc4d5a99f74dbf698ec80a014", + "f0a24dbc494b779606b3fae942042ebb6e42d77cf188d81f5e0895215f24d975", + "ed67e0034372067628553cac0f55d69935203f102d2eae5bccf3e9fd6f8bddee", + "1544c144771491cd8bb6c79ebb199070189032a209a17ae0f5df17d95e0a48e5", + "e2fdafc580819c643c0a89d3ee89d934d4131d06f288295e946b93824e098863", + "6b16af8419f1b67c3d8176c2e2b6adf5ad345d84c797d4621c883d12c5881eed", + "6101922fcf4599ad00260237e8b14904716156d58a25c638578de9775f6546c4", + "0211764bef038cb43a5c8b4e4e1c2189e29c63acc195a8f18f5f52abb6c2d896", + "9fdd3d266a5a068ee069bc4df1c9ad13f5dc11503fe9730fc069dce86d2d0cc5", + "501185fcc47f5bc79f11c17aeb48f6a069298e4538f48c2335f5a5cb18d3d4f7", + "9039f3d010b09f603ec640edceb7861a36dab4b82364c69a208040c3ede48f17", + "751f234599524ba682a48181293f9f24bbfded0b905db1400c4d66e287ae6470", + "c739f4bf1f227963dbdc0ba653351d9b1755ac4b30e4e1fc29a552d1763752c8", + "8e3b632fbec986c803e343ccfb4c8a13c03b04f6212cbe161efe5d5976eb71d1", + "1d20996dfd8ac9c5cd8de5ece58b61abc6e482999a720d8fc6cab8017adfde73", + "74468a7e1be2e9c78afffcbe10b6673e7522120d6679186fd21614fb8d3260fa", + "e47b686632ca64ef9e44b6da170481087bddae257940e54aeaf807b18edb4120", + "23f33513eef75806f25e55dfadf2e09727569c6c57dd020b686cef0c9a6e8324", + "8d59bb2bc1e8a2546b70e875ed5138dfab8f5209888877a7090294b3ba3e8adc", + "92bc28c793c6cf7200794bdbb5c3c821fa205ed1b4b06fcbda8d0124d28e3136", + "cc61018d326cd22a23b07c05db51cfb87618046132d4bedca206cdafa063a20a", + "b370ee273c4fcdb5bde8fb9ef6ddfd45406447ce19c748e418de854c2f0362e3", + "6152c270f83886cf3f5761812c6d8eece4cac8c348230c9b42dd271d1e3f1aba", + "2a9b0d00fb1eb5564fd96a8c1369f9f8e1d32b947cb59a334d47b32c6d963897", + "384c35175bd92ed2c097eebdfa72395a309acb7aa60c390ec3eb66773b661d6e", + "573e038e86e51ae46e5a7992fa652fb4b92632a7065260e12c46d1fd6effefb6", + "005be3a45b8fe905f0d1a63f1306ccc4eab8191d20f6f5a805f4754c20ef2daa", + "9a60982d54be5edfd5af1bd9f7d25dca0be74e77d5eeb6eaf37dcfe06cee188e", + "676257a1528797108e3a5fe031627338e9f09b44297e33aa1463cf46e5bf7db3", + "e7a241cb0337b1b02a56acabcd77baa1363feda4f01cda38d460822da991e3bf", + "7ac458257132ccc040a84b03c9fb7b9ca4fbe0579e7d3428f584da04b5b33527", + "cff2be050d602ec4623227bfe5d17c81c6b4da11e8c00ad7f7ca7d4c6acc878d", + "c07b292e4500a3ff9845bb55d6d69eae602d939e7681ae5d65effe80db4626b6", + "47136ecffbadd0a856d93adf53a2e2b675403386663bbe766bec37d313c87a10", + "eb1bacbee5fd2a2b50535a70ed300e93b90491d7d3d29d2f1f8bc5ecde0d7839", + "15e2db68968bb0000bda5bb3747451926355e9cd63db122bec12a53fb15da9e1", + "1ae6a3722ce9c193df69b1b8a37aa086ec323283628290f7298871676d3c4cba", + "65477882f5794c720233a98e1e383d91deb070f0c2bceb95a5efe7008f854cb5", + "2a630b24aeaeeef20baede1abed05cc9c45794561239f64c6bc291afb4b16120", + "70beda84b736a344f503b4e25e0e4a426f31d7041d283aab464026dfb9714457", + "591cd0ffc4b3b51cff8621ab1458a478c0a0f57305f0551e9e5396dbe8f7d349", + "53625b2b7fcffc9568152e6b6d95472fe850ed163ab341044a0754334cf22e34", + "5751606d1ed8891eae9bd10c5676a54ec196b36b00f9b7d3aa9ab0ab04b5cc25", + "f9f8ac5616f2d1864a6599bafb5f2e6bbc7fba72d6aa23d9ea1e0096de9d4164", + "56241bac3d18e635913ae9db5fac9cdde4e28d74795a1ca77227354d8d38fe1a", + "e01cbe3312394d636a19003923a0ff3eea7f8d2e1d6b42f94777655add3fe9ee", + "d08709244798a43e91f24367176899d90f8678813ec8b822163c67e1740f89c2", + "7571cf1e503d83dd0c915f69b8365e94a1b37aaf98a37d08d4b90e2a3675220f", + "f43f4e2cf5990ca47a833947b671586123e6e73a57d4305a9b813a8ed0d2fb8f", + "12bd6bd6659343e3dd9e6666572c55724a0a9e6990b890b556fe662db9d062e5", + "9ae85f24c4abea079e0223f9f05355dcaf5fbb396291c96d5c3b016099e84bbe", + "495097c042dc6319f9f6480ad049016f113b9c5cfc6d612e04aad56934b919eb", + "4eaa8cc1bf14b329db1097395c1a5ecd0f6fdf5a5de76db7f0339ab9b2c491e4", + "9d9f56a74cd94f45656c40e09823308aed0b4c9e745203cd5950138713026939", + "40797ecc115fee18a4608c9efa1ffeb81c2ee1c4842561ef61fcf7076f1ffedd", + "11cd767ae016d95635cbdfe08538b9347337d6b0847d12697075584b8d0619f1", + "71cb92eeba1ac9e0112a7cf621767729fb77eca209140f248c04f3ca1b0918f8", + "e44a0c43a95543503268b2378dfa0c9161c522c62bee65fa4f4a238875c64b7e", + "8715cacf99e5b7a106cda39fd2b6c96c2e5022974b0f66de7d6a15ed2aaf4eed", + "35bb68dde977abf2784e33d1bf3052893a358a43a8b258bea6a7318b1dd4a310", + "b5bb928fb28bf9699bfbabc626fc279a9ebd1ce6b63c993ddeda7b9eb2f8cf27", + "3fc619d1072c86c3df178b90349411bfed86c49dc777f030f2d27e3100394b00", + "05ede74d5dcb911b02053a895751f92ae86743298c8c6d8c5811de191cd4e5d0", + "18ad4372b90d74e60d68a00e4586b0767c060f9c522d2016c515cc5754eeb06b", + "595447850210071d76266dff3f9ceb530f5fbdf38c9940011abb9b96820f69d0", + "3c80c4cfbea01760facf853c328821cbfa9635adf55a650b92fc41bcfb19c8f5", + "e4feca4d382344176e8ac45592711e4472f76e0667867d469c65ccb5be2c7a19", + "7d0b37fb8ac67f6752e21869e57ed1d8b08be8517ca53ac2835cd2295df094ed", + "4af613e520506104185fc529b07037168b79165ec93e37331dd01f306307a9b7", + "103fa19cc7adb309027f4eafd56cee2c11875358bb4d8d8dd2bbc2f3fe698bb9", + "ede21fac9950f370f23f2a674f795bc7b2eea5c4609ee32fa64d4239218b3d98", + "5b6014bebeefd652030b6f79d14252c51a6f1159a2b37bccdcd3e515e0ae27b9", + "dda18f566e40a3b6e882b5f35ed04328ef8288094d8151bcad76a8c228454f6d", + "bb06814f937b8f4fd23622931286468bccb770a49112c94b23f06e97ffb7aa05", + "9c629de1ccf91a807ae4d7c296108a9ec7880c1cd278e0da344061d329755c14", + "6dbf2e32d098163480ab02a98344750fa5daafc7c66adf4fe90d0eaeeff4f86f", + "4e93b1d6b6d8ee75bf09aa1789933ef1248397e1e3df6ddf8af74eaa04d59c3c", + "6e8f38e9b80a674c58e2d85fb797e0357cd1414528a175f8e06a10b15455bc91", + "d397c5433f574c1a5f9d5c219c91131f3823694a50e04a6a2d896458b76f2e2d", + "f50cc41a1fbfe1a27916b010ce35aed4d7f2803e571225ea1382facd5a603139", + "f375dc182eb989bea2dfe5c2e26a351c3e2c2ea5c8f11447f34004c5c5ca2f27", + "7171793b9c6db5102f6088265373a7c57778f18f440380255a390d5745113652", + "494461bfc7dcc180d454bacd79e12b4a12598e3cf2594b4a96001188df71f27c", + "4ccf4da37de3d59a491675a6cddcc6323deb914a8f458fe6bbd20f4ab824fa69", + "74d21ad3cac9cec15832b98239679ab6360d84ae3d2a36a3f02307d647e7719c", + "b7b45314da2fe600d6377531a57acfd3f5d44c2f0e8641d67f0c9288bab8a3ea", + "7e9025449366165d1e1a7a84b15c89acdb7220595af59d776716b7caf76b517a" + ], + "queries": [], + "alerts": [], + "delta": "unknown", + "coverage": "timeout", + "cache_state": "cold", + "timings": { + "total": 30.56611180899199, + "build": 19.24, + "query": 0.0 + } + } + ] + }, + "runtime": { + "workloads": { + "identical-tip": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.634708732017316, + "p95_seconds": 30.644362346967682, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.6443623469676822, + "pass": false + }, + "function-edit": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.610851514036767, + "p95_seconds": 30.663211637060158, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.663211637060158, + "pass": false + }, + "dependency-edit": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.6267360819038, + "p95_seconds": 30.712326238048263, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.7123262380482629, + "pass": false + }, + "configuration-edit": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.606312285992317, + "p95_seconds": 30.72775209392421, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.7277520939242095, + "pass": false + }, + "cold": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.608712024986744, + "p95_seconds": 30.63113492797129, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.6311349279712886, + "pass": false + }, + "growth": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.893849348067306, + "p95_seconds": 30.912386535899714, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 3, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.9123865358997136, + "pass": false + }, + "multi-ref": { + "population": 3, + "observed": 3, + "missing": 0, + "latency_samples": 3, + "p50_seconds": 30.65246668900363, + "p95_seconds": 30.691843352047727, + "timeouts": 3, + "completed_targets": 0, + "expected_targets": 6, + "complete_target_cases": 0, + "completion": 0.0, + "complete_coverage_cases": 0, + "cancellation_overrun_seconds": 0.6918433520477265, + "pass": false + } + }, + "runtime_verdict": "NO-GO", + "rollout": "NO-GO", + "qualification_limit": "Development NodeGoat, n=3 per workload; independent quality and multi-project performance not established.", + "missing_workloads": [], + "schema_version": 1, + "experiment": "group8-nodegoat-runtime-v1", + "image": "sha256:af5b896b406fe98acb3d00bb2180a7549febd6dd285f0b63087538118e52e1f4", + "profile_sha256": "488232afd5e67e92ab9407980a0f905cbcc0c6e28182e947956b6b6cf0666be5", + "provenance": { + "repository": "/results/nodegoat-v1/objects.git", + "engine_runtime": "2b415139532d8d3a0c6e46ecdac26cd3d792efc2bae441f0b7e39bb28ec5d16e", + "engine": "joern-4.0.625", + "facts": "32edb6e1a78f1afb08ac4248cd436be16663e0d90dc1b3aaf948f2ce49a5a8f0", + "graph_layout": "060428173f47cf33bdf5e532d4069feb598ba0e8c7ea30a60888c8e4cfb37a42", + "queries": "7bf090e053331f03d04c9290c8a593d00efd4d390f4b77b8382c2befc47996cc", + "policy": "5ea302fdc605e23676e09765890c7b491c89a69c2797feb0a5aa3346ddce81ef", + "core": "36ac9a045b8b8ad943eea1f511924caae54750a9d5d45da776ebefc460f08eab", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2", + "ranking_mode": "evidence", + "model": "disabled", + "capabilities": "empty_registry_pending_task_8.3", + "cache": "cold_no_reuse" + }, + "hardware": { + "platform": "Linux-6.8.0-138-generic-x86_64-with-glibc2.39", + "cpu_affinity": [ + 0, + 1, + 2, + 3 + ], + "cpuinfo": "processor\t: 0\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 158\nmodel name\t: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz\nstepping\t: 10\nmicrocode\t: 0xfa\ncpu MHz\t\t: 3192.000\ncache size\t: 16384 KB\nphysical id\t: 0\nsiblings\t: 1\ncore id\t\t: 0\ncpu cores\t: 1\napicid\t\t: 0\ninitial apicid\t: 0\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 22\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault ssbd ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 xsaves arat vnmi umip md_clear flush_l1d arch_capabilities\nvmx flags\t: vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb flexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest shadow_vmcs pml\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs srbds mmio_stale_data retbleed bhi ibpb_no_ret its\nbogomips\t: 6384.00\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 39 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 1\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 158\nmodel name\t: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz\nstepping\t: 10\nmicrocode\t: 0xfa\ncpu MHz\t\t: 3192.000\ncache size\t: 16384 KB\nphysical id\t: 1\nsiblings\t: 1\ncore id\t\t: 0\ncpu cores\t: 1\napicid\t\t: 1\ninitial apicid\t: 1\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 22\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault ssbd ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 xsaves arat vnmi umip md_clear flush_l1d arch_capabilities\nvmx flags\t: vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb flexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest shadow_vmcs pml\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs srbds mmio_stale_data retbleed bhi ibpb_no_ret its\nbogomips\t: 6384.00\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 39 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 2\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 158\nmodel name\t: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz\nstepping\t: 10\nmicrocode\t: 0xfa\ncpu MHz\t\t: 3192.000\ncache size\t: 16384 KB\nphysical id\t: 2\nsiblings\t: 1\ncore id\t\t: 0\ncpu cores\t: 1\napicid\t\t: 2\ninitial apicid\t: 2\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 22\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault ssbd ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 xsaves arat vnmi umip md_clear flush_l1d arch_capabilities\nvmx flags\t: vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb flexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest shadow_vmcs pml\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs srbds mmio_stale_data retbleed bhi ibpb_no_ret its\nbogomips\t: 6384.00\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 39 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 3\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 158\nmodel name\t: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz\nstepping\t: 10\nmicrocode\t: 0xfa\ncpu MHz\t\t: 3192.000\ncache size\t: 16384 KB\nphysical id\t: 3\nsiblings\t: 1\ncore id\t\t: 0\ncpu cores\t: 1\napicid\t\t: 3\ninitial apicid\t: 3\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 22\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault ssbd ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 xsaves arat vnmi umip md_clear flush_l1d arch_capabilities\nvmx flags\t: vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb flexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest shadow_vmcs pml\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs srbds mmio_stale_data retbleed bhi ibpb_no_ret its\nbogomips\t: 6384.00\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 39 bits physical, 48 bits virtual\npower management:\n\n", + "memory_limit": "3221225472" + }, + "input_probe": { + "path": "app/routes/contributions.js", + "bytes": 2485, + "sha256": "196bdeaa22da4cfe8a851b1b932710b2fcedd21f14ed75d70b739ba759a01003" + }, + "sample_count": 21, + "expected_target_checks": 24, + "complete_target_checks": 0, + "priming": { + "id": "lab-prime", + "elapsed_seconds": 224.47236027393956, + "exit_code": 0, + "instrument_error": null, + "timed_out": false, + "target_completed": false, + "completed_targets": 0, + "expected_targets": 1, + "coverage": "incomplete", + "timings": { + "comparison_0_deadline_seconds": 600.0, + "comparison_0_cancellation_allowance_seconds": 2.0, + "comparison_0_resolution_seconds": 0.00692109193187207, + "comparison_0_provenance_seconds": 0.2868837690912187, + "comparison_0_snapshot_seconds": 0.8197841900400817, + "comparison_0_snapshot_reuses": 0, + "comparison_0_discovery_seconds": 6.712452265899628, + "comparison_0_discovery_hits": 0, + "comparison_0_preparation_seconds": 7.551641582977027, + "comparison_0_head_seconds": 102.4524846150307, + "comparison_0_base_seconds": 113.50927831302397, + "comparison_0_admission_seconds": 0.006122270948253572, + "comparison_0_cleanup_seconds": 0.011785765993408859, + "comparison_0_graph_hits": 0, + "comparison_0_query_hits": 0, + "comparison_0_total_seconds": 223.85807027190458, + "total_seconds": 223.87894638301805, + "deadline_seconds": 600.0, + "cancellation_allowance_seconds": 2.0 + }, + "selected": 436, + "deferred": 0, + "stages": [ + { + "stage": "frontend", + "seconds": 4.982722881948575, + "exit_code": 0, + "receipt": true, + "executable": "jssrc2cpg", + "scripts": [] + }, + { + "stage": "overlay", + "seconds": 13.621651508961804, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "overlay.sc" + ] + }, + { + "stage": "census", + "seconds": 12.337514301994815, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "census.sc" + ] + }, + { + "stage": "query", + "seconds": 18.39221175899729, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "taint.sc" + ] + }, + { + "stage": "query", + "seconds": 13.111017563031055, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "dominance.sc" + ] + }, + { + "stage": "query", + "seconds": 12.429657276021317, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "config.sc" + ] + }, + { + "stage": "query", + "seconds": 19.411302927066572, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "taint.sc" + ] + }, + { + "stage": "frontend", + "seconds": 5.707860570051707, + "exit_code": 0, + "receipt": true, + "executable": "jssrc2cpg", + "scripts": [] + }, + { + "stage": "overlay", + "seconds": 15.832738576922566, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "overlay.sc" + ] + }, + { + "stage": "census", + "seconds": 13.896116655902006, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "census.sc" + ] + }, + { + "stage": "query", + "seconds": 18.60998445993755, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "taint.sc" + ] + }, + { + "stage": "query", + "seconds": 14.474358166917227, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "dominance.sc" + ] + }, + { + "stage": "query", + "seconds": 14.400734664988704, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "config.sc" + ] + }, + { + "stage": "query", + "seconds": 22.831895098090172, + "exit_code": 0, + "receipt": true, + "executable": "joern", + "scripts": [ + "taint.sc" + ] + } + ] + }, + "bundle": { + "path": "2026-09-13-nodegoat-feasibility.json.gz", + "sha256": "3174bfc0bd39e10b685d06d8bc28ab39450368f1a441e64bbb5a27a256bf13c6", + "bytes": 1254241, + "files": 116 + }, + "instrument_sha256": "89667b2821bea8d5437a01df1a52e17b596c6b66c132db83e828e444feeabbb8", + "stages_by_workload": { + "identical-tip": { + "frontend": 16.57258843292948, + "overlay": 46.36333934101276, + "census": 21.44899461104069, + "query": 0, + "input_probe": 0 + }, + "function-edit": { + "frontend": 17.311220249161124, + "overlay": 46.13778600492515, + "census": 10.856501498026773, + "query": 0, + "input_probe": 0 + }, + "dependency-edit": { + "frontend": 17.487801696988754, + "overlay": 45.022392168990336, + "census": 11.75914374506101, + "query": 0, + "input_probe": 0 + }, + "configuration-edit": { + "frontend": 17.555444408091716, + "overlay": 46.67416559392586, + "census": 10.313088580965996, + "query": 0, + "input_probe": 0 + }, + "cold": { + "frontend": 16.713468418922275, + "overlay": 45.5736131190788, + "census": 0, + "query": 0, + "input_probe": 0 + }, + "growth": { + "frontend": 19.406804273021407, + "overlay": 42.605494707939215, + "census": 0, + "query": 0, + "input_probe": 0 + }, + "multi-ref": { + "frontend": 18.01197422691621, + "overlay": 46.99900957697537, + "census": 19.20424186089076, + "query": 0, + "input_probe": 0 + } + }, + "limitations": [ + "n=3 per development workload; no independent detector qualification", + "Incomplete priming did not qualify graph/answer reuse; discovery cache is the only established reuse here", + "All timeout samples retained; no warm graph performance established", + "All 21 raw artifact core/fact/query/policy/runtime/semantics identities match the frozen profile", + "Scorer hardened after run to reject invalid samples, missing workload classes and preserve multi-ref target denominators; raw profile, instrument and original scorecard retained unchanged" + ] + }, + "declarations": [ + { + "key": { + "language": "c", + "runtime": "unspecified", + "framework": "libpng", + "family": "memory_safety", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + { + "key": { + "language": "javascript", + "runtime": "unspecified", + "framework": "express", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + { + "key": { + "language": "javascript", + "runtime": "unspecified", + "framework": "express", + "family": "unreviewed", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + { + "key": { + "language": "php", + "runtime": "unspecified", + "framework": "wordpress", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + { + "key": { + "language": "python", + "runtime": "unspecified", + "framework": "flask", + "family": "access_control", + "mechanism": "dominance", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + }, + { + "key": { + "language": "python", + "runtime": "unspecified", + "framework": "flask", + "family": "injection", + "mechanism": "taint", + "context": "unreviewed", + "semantics": "f652da2ca5891b6e86a242318357a36f4e3b95529fea596f7d064ef35b2d6cd2" + }, + "evaluation_id": "unqualified-population-v1", + "evaluation_artifact": "/results/qualification-development-v1/scorecard.json", + "verdict": "experimental", + "consequence_template": "Unreviewed consequence for {operation} in {context}.", + "repair_template": "Unreviewed repair for {operation} in {context}.", + "enabled": false, + "positive_controls": 0, + "reviewed_alerts": 0, + "calibration_artifact": null, + "untouched_workload": null, + "operation_symbols": [] + } + ] + }, + "artifact_sha256": "2ddd94d4dc3fd6b84e7de38e5f211d2653fb993c64e4e43cedf7e06062c3265c" +} diff --git a/src/openultrasast/push/eligibility.py b/src/openultrasast/push/eligibility.py new file mode 100644 index 0000000..59094e4 --- /dev/null +++ b/src/openultrasast/push/eligibility.py @@ -0,0 +1,171 @@ +"""Versioned, locally shipped capability eligibility from frozen evaluation evidence. + +This verifies integrity and recomputes gates; it is not a signature verifier. Registry +files are trusted release inputs, never repository configuration or model responses. +""" + +from __future__ import annotations + +import json +import math +from collections.abc import Mapping, Sequence +from dataclasses import dataclass, replace +from pathlib import Path +from typing import Any + +from openultrasast.cpg.artifact import digest_value +from openultrasast.push.policy import CapabilityAdmission +from openultrasast.push_scoring import _metrics, score + +_BINDINGS = ("core", "engine", "engine_runtime", "facts", "queries", "policy", "semantics") +_WORKLOADS = ("identical-tip", "function-edit", "dependency-edit", "configuration-edit", "cold", "growth", "multi-ref") +_DEFAULT = Path(__file__).with_name("eligibility.json") + + +@dataclass(frozen=True) +class EligibilityLoad: + capabilities: tuple[CapabilityAdmission, ...] + status: str + reasons: tuple[str, ...] + + +def fingerprint() -> str: + try: + return digest_value(json.loads(_DEFAULT.read_bytes())) + except (OSError, ValueError): + return "eligibility_unavailable" + + +def _runtime_pass(runtime: Mapping[str, Any], current: Mapping[str, str]) -> bool: + if runtime.get("runtime_verdict") != "PASS" or any(runtime.get("provenance", {}).get(k) != current.get(k) for k in _BINDINGS): + return False + try: + for name in _WORKLOADS: + row = runtime["workloads"][name] + values = [ + row[k] + for k in ( + "population", + "observed", + "missing", + "latency_samples", + "p95_seconds", + "completion", + "complete_coverage_cases", + "cancellation_overrun_seconds", + "timeouts", + ) + ] + if any(type(v) not in (int, float) or not math.isfinite(v) or v < 0 for v in values): + return False + population = row["population"] + if ( + population < 1 + or row["observed"] != population + or row["latency_samples"] != population + or row["missing"] + or row["timeouts"] + or row["completion"] < 0.95 + or row["complete_coverage_cases"] / population < 0.95 + or row["cancellation_overrun_seconds"] > 2 + or (name != "cold" and row["p95_seconds"] > 30) + ): + return False + except (KeyError, TypeError, ZeroDivisionError): + return False + return True + + +def create_decision( + profile: dict[str, Any], + validation: dict[str, Any], + run: dict[str, Any], + *, + current: Mapping[str, str], + runtime: dict[str, Any], + declarations: Sequence[CapabilityAdmission], +) -> dict[str, Any]: + scored = score(profile, validation, run) + bindings = {k: current.get(k, "") for k in _BINDINGS} + common = [] + if any(not bindings[k] or profile["config"].get(k) != bindings[k] for k in _BINDINGS): + common.append("evaluation_provenance_mismatch") + if not _runtime_pass(runtime, current): + common.append("runtime_gate_or_provenance_failed") + entries = [] + for declaration in declarations: + key = declaration.key + capability = f"{key.language}/{key.framework}/{key.family}" + rows = [r for r in scored["cases"] if r["capability"] == capability and r["label"] != "regression"] + metrics = _metrics(rows) + reasons = list(common) + labels = {r["label"] for r in rows} + if not {"vulnerable", "fixed", "benign"} <= labels: + reasons.append("paired_positive_fixed_benign_population_missing") + if any(r["label"] in ("unsupported", "unreviewed") or r["input_status"] != "ready" or r.get("prerequisites") for r in rows): + reasons.append("unresolved_input_or_unsupported_population") + if not declaration.untouched_workload or any( + r.get("role") not in ("independent", "reserved") or r.get("workload") != declaration.untouched_workload for r in rows + ): + reasons.append("independent_workload_missing") + semantic = profile["config"].get("capability_semantics", {}).get(digest_value(key.to_payload()), {}) + if ( + semantic.get("key") != key.to_payload() + or semantic.get("operation_symbols") != list(declaration.operation_symbols) + or semantic.get("review_id") != declaration.evaluation_id + or semantic.get("consequence_template") != declaration.consequence_template + or semantic.get("repair_template") != declaration.repair_template + or not declaration.operation_symbols + or key.semantics != bindings["semantics"] + or key.context in ("unreviewed", "unspecified", "") + or not declaration.calibration_artifact + ): + reasons.append("semantic_scope_unreviewed_or_mismatched") + for name, threshold in (("precision", 0.95), ("actionable_recall", 0.90), ("completion", 0.95), ("query_completion", 0.95)): + if metrics[name]["value"] is None or metrics[name]["value"] < threshold: + reasons.append(name + "_gate_failed") + if metrics["fixed_side_silence"]["value"] != 1 or metrics["benign_interruption"]["value"] != 0: + reasons.append("fixed_or_benign_gate_failed") + warm = metrics["latency"]["warm_changed"] + if not warm["samples"] or warm["p95"] > 30: + reasons.append("independent_warm_latency_missing_or_failed") + positive = metrics["recall"]["numerator"] + reviewed = metrics["precision"]["numerator"] + if positive < 1 or reviewed < 1: + reasons.append("positive_controls_or_reviewed_alerts_missing") + accepted = not reasons + resolved = replace( + declaration, verdict="PASS" if accepted else "NO-GO", enabled=accepted, positive_controls=positive, reviewed_alerts=reviewed + ) + entries.append(dict(declaration=resolved.to_payload(), metrics=metrics, reasons=sorted(set(reasons)))) + result = dict( + schema_version=1, + bindings=bindings, + verdict="PASS" if any(not e["reasons"] for e in entries) else "NO-GO", + entries=entries, + inputs=dict(profile=profile, validation=validation, run=run, runtime=runtime, declarations=[d.to_payload() for d in declarations]), + ) + result["artifact_sha256"] = digest_value(result) + return result + + +def load_registry(*, current: Mapping[str, str], path: Path | None = None) -> EligibilityLoad: + try: + with (path or _DEFAULT).open("rb") as stream: + content = stream.read(2 * 1024**2 + 1) + if len(content) > 2 * 1024**2: + raise ValueError("registry_size_limit") + data = json.loads(content) + if data.get("schema_version") != 1 or data.get("bindings") != {k: current.get(k, "") for k in _BINDINGS}: + return EligibilityLoad((), "stale", ("eligibility_provenance_mismatch",)) + inputs = data["inputs"] + declarations = tuple(CapabilityAdmission.from_payload(d) for d in inputs["declarations"]) + recomputed = create_decision( + inputs["profile"], inputs["validation"], inputs["run"], current=current, runtime=inputs["runtime"], declarations=declarations + ) + if recomputed != data: + raise ValueError("registry_evidence_mismatch") + capabilities = tuple(CapabilityAdmission.from_payload(e["declaration"]) for e in data["entries"] if not e["reasons"]) + return EligibilityLoad(capabilities, data["verdict"], tuple(sorted({reason for e in data["entries"] for reason in e["reasons"]}))) + except (OSError, ValueError, TypeError, KeyError, AttributeError): + return EligibilityLoad((), "unavailable", ("eligibility_invalid_or_unavailable",)) diff --git a/src/openultrasast/push/runner.py b/src/openultrasast/push/runner.py index 9eb740b..adcdc01 100644 --- a/src/openultrasast/push/runner.py +++ b/src/openultrasast/push/runner.py @@ -26,6 +26,7 @@ from openultrasast.model.shipped import declared_sources from openultrasast.preprocess import build_file_target, enumerate_source_files from openultrasast.push.cache import ArtifactCache, SemanticKeys from openultrasast.push.contracts import ComparisonAnalysis, PushComparison, PushResult, SnapshotManifest +from openultrasast.push.eligibility import fingerprint, load_registry from openultrasast.push.policy import ( ActionableDefect, AdmissionCandidate, @@ -151,11 +152,22 @@ def _provenance(repository: Path, scan_budget: ScanBudget) -> dict[str, str]: ), "ranking_mode": "evidence", "model": "disabled", - "capabilities": "empty_registry_pending_task_8.3", + "capabilities": fingerprint(), "cache": "cold_no_reuse", } +def _admit(candidates: tuple[AdmissionCandidate, ...], provenance: dict[str, str]) -> AdmissionResult: + registry = load_registry(current=provenance) + result = admit_candidates(candidates, capabilities=registry.capabilities) + if candidates and registry.reasons: + result = replace( + result, + coverage_reasons=tuple(dict.fromkeys((*result.coverage_reasons, *("eligibility:" + reason for reason in registry.reasons)))), + ) + return result + + def _discovery_identity() -> str: root = Path(__file__).resolve().parents[1] # Discovery invokes the shipped mapper, preprocessing, layout and family specs. @@ -326,7 +338,7 @@ def _analyze( ) for c in delta.candidates ) - admission = _prepare(lambda: admit_candidates(candidates), budget) + admission = _prepare(lambda: _admit(candidates, provenance), budget) timings[stage + "_seconds"] = time.monotonic() - stage_started stage, stage_started = "cleanup", time.monotonic() timings[stage + "_seconds"] = time.monotonic() - stage_started diff --git a/tests/test_push_eligibility.py b/tests/test_push_eligibility.py new file mode 100644 index 0000000..8811150 --- /dev/null +++ b/tests/test_push_eligibility.py @@ -0,0 +1,163 @@ +"""Synthetic eligibility contracts, not real capability qualification.""" + +import copy +import json +from dataclasses import replace + +import pytest +from test_push_admission import control +from test_push_scoring import inputs, record + +from openultrasast.push.eligibility import create_decision, load_registry +from openultrasast.push_scoring import freeze_profile + + +def fixture(): + old, validation = inputs() + current = {key: "synthetic-" + key for key in ("core", "engine", "engine_runtime", "facts", "queries", "policy", "semantics")} + from openultrasast.cpg.artifact import digest_value + + _, declaration, _ = control() + declaration = replace(declaration, key=replace(declaration.key, semantics=current["semantics"]), untouched_workload="untouched-control") + config = { + **old["config"], + **current, + "capability_semantics": { + digest_value(declaration.key.to_payload()): { + "key": declaration.key.to_payload(), + "operation_symbols": list(declaration.operation_symbols), + "review_id": declaration.evaluation_id, + "consequence_template": declaration.consequence_template, + "repair_template": declaration.repair_template, + } + }, + } + cases = [{**row, "role": "independent", "workload": "untouched-control"} for row in old["cases"][:3]] + raw = json.dumps({"schema_version": 1, "cases": cases}).encode() + profile = freeze_profile(raw, config) + validation = {**validation, "manifest_sha256": profile["manifest_sha256"], "cases": [{**c, "status": "ready"} for c in cases]} + positive = record( + alerts=[dict(review="actionable_true", review_evidence="synthetic-review", question_id="q-handler", site="api.js:4")], + cache_state="warm_changed", + ) + fixed = record( + "fixed", + queries=[ + dict( + id="q-handler", + status="answered", + outcome="negative", + target=config["targets"]["fixed"], + witness="bound parameter discharges target", + ) + ], + delta="removed", + cache_state="warm_changed", + ) + benign = record("benign", delta="unchanged", cache_state="warm_changed") + run = {"profile_sha256": profile["profile_sha256"], "context": config, "records": [positive, fixed, benign]} + _, declaration, _ = control() + declaration = replace(declaration, key=replace(declaration.key, semantics=current["semantics"]), untouched_workload="untouched-control") + runtime = { + "runtime_verdict": "PASS", + "provenance": current, + "workloads": { + name: dict( + population=3, + observed=3, + missing=0, + latency_samples=3, + p95_seconds=3, + completion=1, + complete_coverage_cases=3, + cancellation_overrun_seconds=0, + timeouts=0, + ) + for name in ("identical-tip", "function-edit", "dependency-edit", "configuration-edit", "cold", "growth", "multi-ref") + }, + } + return profile, validation, run, current, runtime, (declaration,) + + +def decision(parts): + profile, validation, run, current, runtime, declarations = parts + return create_decision(profile, validation, run, current=current, runtime=runtime, declarations=declarations) + + +def test_matching_reviewed_synthetic_population_can_be_loaded(tmp_path): + parts = fixture() + data = decision(parts) + assert data["verdict"] == "PASS" + path = tmp_path / "eligibility.json" + path.write_text(json.dumps(data)) + loaded = load_registry(current=parts[3], path=path) + assert len(loaded.capabilities) == 1 + assert loaded.capabilities[0].enabled + assert loaded.capabilities[0].positive_controls == 1 + assert loaded.capabilities[0].reviewed_alerts == 1 + + +@pytest.mark.parametrize("mutation", ["no_alert", "runtime", "stale_runtime", "no_independent", "no_positive", "wrong_semantics"]) +def test_missing_joint_evidence_never_enables_advisory(mutation, tmp_path): + parts = list(copy.deepcopy(fixture())) + if mutation == "no_alert": + parts[2]["records"][0]["alerts"] = [] + elif mutation == "runtime": + parts[4]["workloads"]["function-edit"]["p95_seconds"] = 31 + elif mutation == "stale_runtime": + parts[4]["provenance"]["policy"] = "other" + elif mutation == "no_independent": + parts[5] = (replace(parts[5][0], untouched_workload="wrong-repository"),) + elif mutation == "no_positive": + parts[2]["records"] = parts[2]["records"][1:] + else: + parts[5] = (replace(parts[5][0], key=replace(parts[5][0].key, semantics="wrong")),) + data = decision(parts) + assert data["verdict"] == "NO-GO" + path = tmp_path / "eligibility.json" + path.write_text(json.dumps(data)) + assert not load_registry(current=parts[3], path=path).capabilities + + +def test_stale_or_tampered_registry_is_rejected(tmp_path): + parts = fixture() + data = decision(parts) + path = tmp_path / "eligibility.json" + path.write_text(json.dumps(data)) + stale = {**parts[3], "facts": "new-facts"} + assert not load_registry(current=stale, path=path).capabilities + data["entries"][0]["declaration"]["repair_template"] = "invented advice" + path.write_text(json.dumps(data)) + assert not load_registry(current=parts[3], path=path).capabilities + + +def test_runner_consumes_only_matching_registry(tmp_path, monkeypatch): + import openultrasast.push.eligibility as registry + from openultrasast.push.runner import _admit + + parts = fixture() + data = decision(parts) + path = tmp_path / "eligibility.json" + path.write_text(json.dumps(data)) + monkeypatch.setattr(registry, "_DEFAULT", path) + candidate, _, _ = control() + candidate = replace(candidate, capability=parts[5][0].key, delta=replace(candidate.delta, semantics=parts[3]["semantics"])) + assert len(_admit((candidate,), parts[3]).defects) == 1 + assert not _admit((candidate,), {**parts[3], "facts": "changed"}).defects + + +def test_changed_semantic_advice_needs_a_new_frozen_review(): + parts = list(fixture()) + parts[5] = (replace(parts[5][0], repair_template="Unreviewed advice at {operation} for {context}"),) + assert decision(parts)["verdict"] == "NO-GO" + + +def test_shipped_registry_is_reproducible_no_go(): + from openultrasast.push.eligibility import _DEFAULT + + data = json.loads(_DEFAULT.read_bytes()) + loaded = load_registry(current=data["bindings"]) + assert loaded.status == "NO-GO" + assert not loaded.capabilities + assert data["entries"] + assert all(not row["declaration"]["enabled"] for row in data["entries"])