Files
Open_Ultra_SAST/plane/runs/validation-46.yaml
T
Marius CiepluchandClaude Opus 5.5 b68fe27c74 feat(plane): the improvement loop as a plane Run (harnessx-removal task 4)
`ousast plane workspaces --validation-set ... --loop` appends the loop to a Run:
per case `alerts` (plane/tasks/alerts.py: the quick-mode scan on the vulnerable
and the fixed pin, a fixed-pin Workspace per case, alerts attributed to their
enclosing function by the repo-facts patterns, `in_fix_range` from the fix's
old-side and new-side ranges, failing on an unread tree) feeding `remember`,
then `memory-snapshot` -> `loop-measure` -> `loop-propose` -> `loop-improve`
(plane/tasks/loop.py). Every new task binds no Model and has budget
{usd: 0, calls: 0}. The snapshot is the store's rows after the train-on-test
guard, written on the host by memory.seed (a sandboxed run of it fails loudly);
propose runs M1/M2 against this repository at the commit under test; improve
runs one unchanged evolve.run_round and delivers gate.json, journal.json, the
sidecar, rule_policy.json only when accepted, and proposal_outcome rows that
the host ingests. Adoption stays a maintainer commit.

`remember` is now a Run entry per case (the image contains it), with the facts
row keyed by the image the facts were computed on (repo-facts records it in
its summary; unknown -> the row is omitted, never guessed). Alert rows carry
their own pin; improve/memory.py counts a repeated alert once.

Runner image rebuilt (+0.39 MB: only the new modules; the quick scan needs no
extra and the rulesets were already in the package), pushed, plane/ re-pinned
and regenerated (validation-46: 105 entries). Fixture test runs the whole loop
graph through the fake ax, whose new `exec` mode runs the real task modules.
Live: one loop Run over three validation-46 cases on the local ax, recorded in
benchmarks/measurements/2026-09-30-harnessx-removal-loop/ (all done, $0 new
spend, 0 proposals, gate verdict no_proposals).

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EmM1j46qgKMh3zqD1QMwEo
2026-09-30 11:59:50 +02:00

1197 lines
36 KiB
YAML

# generated by `ousast plane workspaces benchmarks/independent/population-v2.toml --validation-set ~/ousast-results/independent-v2-sets/validation.json --candidates ~/ousast-results/independent-v2-modelsinks --triage ~/ousast-results/independent-v2-batched-check/scans --repos ~/.cache/openultrasast/independent --run validation-46 --runner-image ~/.cache/ousast/ax-src/runner-image`; do not edit, regenerate.
# 15 cases, 46 candidates (43 kept by the recorded triage); usd ceiling 3.03.
apiVersion: openultrasast.io/v1alpha1
kind: Run
metadata:
name: validation-46
annotations:
openultrasast.io/population: population-v2
openultrasast.io/split: validation
spec:
tasks:
- name: budibase-mongo-template-nosqli-facts
task: repo-facts-budibase-mongo-template-nosqli
outputs:
- facts.json
budget: &id001
usd: 0
calls: 0
serialize: repo-facts
- name: budibase-mongo-template-nosqli-va
task: verify-a-budibase-mongo-template-nosqli
inputs:
facts: budibase-mongo-template-nosqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.06
calls: 16
- name: budibase-mongo-template-nosqli-vb
task: verify-b-budibase-mongo-template-nosqli
inputs:
facts: budibase-mongo-template-nosqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.06
calls: 16
- name: budibase-mongo-template-nosqli-agree
task: agree-budibase-mongo-template-nosqli
inputs:
pass_a: budibase-mongo-template-nosqli-va/units.jsonl
pass_b: budibase-mongo-template-nosqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id001
- name: cct-studio-server-cmdi-facts
task: repo-facts-cct-studio-server-cmdi
outputs:
- facts.json
budget: &id002
usd: 0
calls: 0
serialize: repo-facts
- name: cct-studio-server-cmdi-va
task: verify-a-cct-studio-server-cmdi
inputs:
facts: cct-studio-server-cmdi-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: cct-studio-server-cmdi-vb
task: verify-b-cct-studio-server-cmdi
inputs:
facts: cct-studio-server-cmdi-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: cct-studio-server-cmdi-agree
task: agree-cct-studio-server-cmdi
inputs:
pass_a: cct-studio-server-cmdi-va/units.jsonl
pass_b: cct-studio-server-cmdi-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id002
- name: contextforge-prompt-ssti-facts
task: repo-facts-contextforge-prompt-ssti
outputs:
- facts.json
budget: &id003
usd: 0
calls: 0
serialize: repo-facts
- name: contextforge-prompt-ssti-va
task: verify-a-contextforge-prompt-ssti
inputs:
facts: contextforge-prompt-ssti-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: contextforge-prompt-ssti-vb
task: verify-b-contextforge-prompt-ssti
inputs:
facts: contextforge-prompt-ssti-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: contextforge-prompt-ssti-agree
task: agree-contextforge-prompt-ssti
inputs:
pass_a: contextforge-prompt-ssti-va/units.jsonl
pass_b: contextforge-prompt-ssti-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id003
- name: froxlor-admin-ip-second-order-sqli-facts
task: repo-facts-froxlor-admin-ip-second-order-sqli
outputs:
- facts.json
budget: &id004
usd: 0
calls: 0
serialize: repo-facts
- name: froxlor-admin-ip-second-order-sqli-va
task: verify-a-froxlor-admin-ip-second-order-sqli
inputs:
facts: froxlor-admin-ip-second-order-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.07
calls: 16
- name: froxlor-admin-ip-second-order-sqli-vb
task: verify-b-froxlor-admin-ip-second-order-sqli
inputs:
facts: froxlor-admin-ip-second-order-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.07
calls: 16
- name: froxlor-admin-ip-second-order-sqli-agree
task: agree-froxlor-admin-ip-second-order-sqli
inputs:
pass_a: froxlor-admin-ip-second-order-sqli-va/units.jsonl
pass_b: froxlor-admin-ip-second-order-sqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id004
- name: fuxa-tdengine-escape-sqli-facts
task: repo-facts-fuxa-tdengine-escape-sqli
outputs:
- facts.json
budget: &id005
usd: 0
calls: 0
serialize: repo-facts
- name: fuxa-tdengine-escape-sqli-va
task: verify-a-fuxa-tdengine-escape-sqli
inputs:
facts: fuxa-tdengine-escape-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.12
calls: 8
- name: fuxa-tdengine-escape-sqli-vb
task: verify-b-fuxa-tdengine-escape-sqli
inputs:
facts: fuxa-tdengine-escape-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.12
calls: 8
- name: fuxa-tdengine-escape-sqli-agree
task: agree-fuxa-tdengine-escape-sqli
inputs:
pass_a: fuxa-tdengine-escape-sqli-va/units.jsonl
pass_b: fuxa-tdengine-escape-sqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id005
- name: lmdeploy-media-url-ssrf-facts
task: repo-facts-lmdeploy-media-url-ssrf
outputs:
- facts.json
budget: &id006
usd: 0
calls: 0
serialize: repo-facts
- name: lmdeploy-media-url-ssrf-va
task: verify-a-lmdeploy-media-url-ssrf
inputs:
facts: lmdeploy-media-url-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: lmdeploy-media-url-ssrf-vb
task: verify-b-lmdeploy-media-url-ssrf
inputs:
facts: lmdeploy-media-url-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: lmdeploy-media-url-ssrf-agree
task: agree-lmdeploy-media-url-ssrf
inputs:
pass_a: lmdeploy-media-url-ssrf-va/units.jsonl
pass_b: lmdeploy-media-url-ssrf-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id006
- name: medplum-external-auth-open-redirect-facts
task: repo-facts-medplum-external-auth-open-redirect
outputs:
- facts.json
budget: &id007
usd: 0
calls: 0
serialize: repo-facts
- name: medplum-external-auth-open-redirect-va
task: verify-a-medplum-external-auth-open-redirect
inputs:
facts: medplum-external-auth-open-redirect-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: medplum-external-auth-open-redirect-vb
task: verify-b-medplum-external-auth-open-redirect
inputs:
facts: medplum-external-auth-open-redirect-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: medplum-external-auth-open-redirect-agree
task: agree-medplum-external-auth-open-redirect
inputs:
pass_a: medplum-external-auth-open-redirect-va/units.jsonl
pass_b: medplum-external-auth-open-redirect-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id007
- name: pgadmin-maintenance-sqli-facts
task: repo-facts-pgadmin-maintenance-sqli
outputs:
- facts.json
budget: &id008
usd: 0
calls: 0
serialize: repo-facts
- name: pgadmin-maintenance-sqli-va
task: verify-a-pgadmin-maintenance-sqli
inputs:
facts: pgadmin-maintenance-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.45
calls: 96
- name: pgadmin-maintenance-sqli-vb
task: verify-b-pgadmin-maintenance-sqli
inputs:
facts: pgadmin-maintenance-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.45
calls: 96
- name: pgadmin-maintenance-sqli-agree
task: agree-pgadmin-maintenance-sqli
inputs:
pass_a: pgadmin-maintenance-sqli-va/units.jsonl
pass_b: pgadmin-maintenance-sqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id008
- name: qwed-sympy-eval-facts
task: repo-facts-qwed-sympy-eval
outputs:
- facts.json
budget: &id009
usd: 0
calls: 0
serialize: repo-facts
- name: qwed-sympy-eval-va
task: verify-a-qwed-sympy-eval
inputs:
facts: qwed-sympy-eval-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: qwed-sympy-eval-vb
task: verify-b-qwed-sympy-eval
inputs:
facts: qwed-sympy-eval-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: qwed-sympy-eval-agree
task: agree-qwed-sympy-eval
inputs:
pass_a: qwed-sympy-eval-va/units.jsonl
pass_b: qwed-sympy-eval-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id009
- name: reactpress-findall-column-sqli-facts
task: repo-facts-reactpress-findall-column-sqli
outputs:
- facts.json
budget: &id010
usd: 0
calls: 0
serialize: repo-facts
- name: reactpress-findall-column-sqli-va
task: verify-a-reactpress-findall-column-sqli
inputs:
facts: reactpress-findall-column-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: reactpress-findall-column-sqli-vb
task: verify-b-reactpress-findall-column-sqli
inputs:
facts: reactpress-findall-column-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: reactpress-findall-column-sqli-agree
task: agree-reactpress-findall-column-sqli
inputs:
pass_a: reactpress-findall-column-sqli-va/units.jsonl
pass_b: reactpress-findall-column-sqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id010
- name: unleash-addon-webhook-ssrf-facts
task: repo-facts-unleash-addon-webhook-ssrf
outputs:
- facts.json
budget: &id011
usd: 0
calls: 0
serialize: repo-facts
- name: unleash-addon-webhook-ssrf-va
task: verify-a-unleash-addon-webhook-ssrf
inputs:
facts: unleash-addon-webhook-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: unleash-addon-webhook-ssrf-vb
task: verify-b-unleash-addon-webhook-ssrf
inputs:
facts: unleash-addon-webhook-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: unleash-addon-webhook-ssrf-agree
task: agree-unleash-addon-webhook-ssrf
inputs:
pass_a: unleash-addon-webhook-ssrf-va/units.jsonl
pass_b: unleash-addon-webhook-ssrf-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id011
- name: winml-cli-serve-cors-facts
task: repo-facts-winml-cli-serve-cors
outputs:
- facts.json
budget: &id012
usd: 0
calls: 0
serialize: repo-facts
- name: winml-cli-serve-cors-va
task: verify-a-winml-cli-serve-cors
inputs:
facts: winml-cli-serve-cors-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: winml-cli-serve-cors-vb
task: verify-b-winml-cli-serve-cors
inputs:
facts: winml-cli-serve-cors-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: winml-cli-serve-cors-agree
task: agree-winml-cli-serve-cors
inputs:
pass_a: winml-cli-serve-cors-va/units.jsonl
pass_b: winml-cli-serve-cors-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id012
- name: wp-directorist-avatar-ssrf-facts
task: repo-facts-wp-directorist-avatar-ssrf
outputs:
- facts.json
budget: &id013
usd: 0
calls: 0
serialize: repo-facts
- name: wp-directorist-avatar-ssrf-va
task: verify-a-wp-directorist-avatar-ssrf
inputs:
facts: wp-directorist-avatar-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: wp-directorist-avatar-ssrf-vb
task: verify-b-wp-directorist-avatar-ssrf
inputs:
facts: wp-directorist-avatar-ssrf-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: wp-directorist-avatar-ssrf-agree
task: agree-wp-directorist-avatar-ssrf
inputs:
pass_a: wp-directorist-avatar-ssrf-va/units.jsonl
pass_b: wp-directorist-avatar-ssrf-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id013
- name: wp-gopay-log-filter-sqli-facts
task: repo-facts-wp-gopay-log-filter-sqli
outputs:
- facts.json
budget: &id014
usd: 0
calls: 0
serialize: repo-facts
- name: wp-gopay-log-filter-sqli-va
task: verify-a-wp-gopay-log-filter-sqli
inputs:
facts: wp-gopay-log-filter-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: wp-gopay-log-filter-sqli-vb
task: verify-b-wp-gopay-log-filter-sqli
inputs:
facts: wp-gopay-log-filter-sqli-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: wp-gopay-log-filter-sqli-agree
task: agree-wp-gopay-log-filter-sqli
inputs:
pass_a: wp-gopay-log-filter-sqli-va/units.jsonl
pass_b: wp-gopay-log-filter-sqli-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id014
- name: wp-groundhogg-confirm-redirect-facts
task: repo-facts-wp-groundhogg-confirm-redirect
outputs:
- facts.json
budget: &id015
usd: 0
calls: 0
serialize: repo-facts
- name: wp-groundhogg-confirm-redirect-va
task: verify-a-wp-groundhogg-confirm-redirect
inputs:
facts: wp-groundhogg-confirm-redirect-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.05
calls: 8
- name: wp-groundhogg-confirm-redirect-vb
task: verify-b-wp-groundhogg-confirm-redirect
inputs:
facts: wp-groundhogg-confirm-redirect-facts/facts.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.05
calls: 8
- name: wp-groundhogg-confirm-redirect-agree
task: agree-wp-groundhogg-confirm-redirect
inputs:
pass_a: wp-groundhogg-confirm-redirect-va/units.jsonl
pass_b: wp-groundhogg-confirm-redirect-vb/units.jsonl
outputs:
- agreed.json
- disputed.json
budget: *id015
- name: budibase-mongo-template-nosqli-vc
task: verify-c-budibase-mongo-template-nosqli
dependsOn:
- budibase-mongo-template-nosqli-agree
inputs:
facts: budibase-mongo-template-nosqli-facts/facts.json
only: budibase-mongo-template-nosqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.06
calls: 16
- name: budibase-mongo-template-nosqli-final
task: agree-budibase-mongo-template-nosqli
inputs:
pass_a: budibase-mongo-template-nosqli-va/units.jsonl
pass_b: budibase-mongo-template-nosqli-vb/units.jsonl
pass_c: budibase-mongo-template-nosqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: cct-studio-server-cmdi-vc
task: verify-c-cct-studio-server-cmdi
dependsOn:
- cct-studio-server-cmdi-agree
inputs:
facts: cct-studio-server-cmdi-facts/facts.json
only: cct-studio-server-cmdi-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: cct-studio-server-cmdi-final
task: agree-cct-studio-server-cmdi
inputs:
pass_a: cct-studio-server-cmdi-va/units.jsonl
pass_b: cct-studio-server-cmdi-vb/units.jsonl
pass_c: cct-studio-server-cmdi-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: contextforge-prompt-ssti-vc
task: verify-c-contextforge-prompt-ssti
dependsOn:
- contextforge-prompt-ssti-agree
inputs:
facts: contextforge-prompt-ssti-facts/facts.json
only: contextforge-prompt-ssti-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.04
calls: 8
- name: contextforge-prompt-ssti-final
task: agree-contextforge-prompt-ssti
inputs:
pass_a: contextforge-prompt-ssti-va/units.jsonl
pass_b: contextforge-prompt-ssti-vb/units.jsonl
pass_c: contextforge-prompt-ssti-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: froxlor-admin-ip-second-order-sqli-vc
task: verify-c-froxlor-admin-ip-second-order-sqli
dependsOn:
- froxlor-admin-ip-second-order-sqli-agree
inputs:
facts: froxlor-admin-ip-second-order-sqli-facts/facts.json
only: froxlor-admin-ip-second-order-sqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.07
calls: 16
- name: froxlor-admin-ip-second-order-sqli-final
task: agree-froxlor-admin-ip-second-order-sqli
inputs:
pass_a: froxlor-admin-ip-second-order-sqli-va/units.jsonl
pass_b: froxlor-admin-ip-second-order-sqli-vb/units.jsonl
pass_c: froxlor-admin-ip-second-order-sqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: fuxa-tdengine-escape-sqli-vc
task: verify-c-fuxa-tdengine-escape-sqli
dependsOn:
- fuxa-tdengine-escape-sqli-agree
inputs:
facts: fuxa-tdengine-escape-sqli-facts/facts.json
only: fuxa-tdengine-escape-sqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.12
calls: 8
- name: fuxa-tdengine-escape-sqli-final
task: agree-fuxa-tdengine-escape-sqli
inputs:
pass_a: fuxa-tdengine-escape-sqli-va/units.jsonl
pass_b: fuxa-tdengine-escape-sqli-vb/units.jsonl
pass_c: fuxa-tdengine-escape-sqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: lmdeploy-media-url-ssrf-vc
task: verify-c-lmdeploy-media-url-ssrf
dependsOn:
- lmdeploy-media-url-ssrf-agree
inputs:
facts: lmdeploy-media-url-ssrf-facts/facts.json
only: lmdeploy-media-url-ssrf-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: lmdeploy-media-url-ssrf-final
task: agree-lmdeploy-media-url-ssrf
inputs:
pass_a: lmdeploy-media-url-ssrf-va/units.jsonl
pass_b: lmdeploy-media-url-ssrf-vb/units.jsonl
pass_c: lmdeploy-media-url-ssrf-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: medplum-external-auth-open-redirect-vc
task: verify-c-medplum-external-auth-open-redirect
dependsOn:
- medplum-external-auth-open-redirect-agree
inputs:
facts: medplum-external-auth-open-redirect-facts/facts.json
only: medplum-external-auth-open-redirect-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: medplum-external-auth-open-redirect-final
task: agree-medplum-external-auth-open-redirect
inputs:
pass_a: medplum-external-auth-open-redirect-va/units.jsonl
pass_b: medplum-external-auth-open-redirect-vb/units.jsonl
pass_c: medplum-external-auth-open-redirect-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: pgadmin-maintenance-sqli-vc
task: verify-c-pgadmin-maintenance-sqli
dependsOn:
- pgadmin-maintenance-sqli-agree
inputs:
facts: pgadmin-maintenance-sqli-facts/facts.json
only: pgadmin-maintenance-sqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.45
calls: 96
- name: pgadmin-maintenance-sqli-final
task: agree-pgadmin-maintenance-sqli
inputs:
pass_a: pgadmin-maintenance-sqli-va/units.jsonl
pass_b: pgadmin-maintenance-sqli-vb/units.jsonl
pass_c: pgadmin-maintenance-sqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: qwed-sympy-eval-vc
task: verify-c-qwed-sympy-eval
dependsOn:
- qwed-sympy-eval-agree
inputs:
facts: qwed-sympy-eval-facts/facts.json
only: qwed-sympy-eval-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: qwed-sympy-eval-final
task: agree-qwed-sympy-eval
inputs:
pass_a: qwed-sympy-eval-va/units.jsonl
pass_b: qwed-sympy-eval-vb/units.jsonl
pass_c: qwed-sympy-eval-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: reactpress-findall-column-sqli-vc
task: verify-c-reactpress-findall-column-sqli
dependsOn:
- reactpress-findall-column-sqli-agree
inputs:
facts: reactpress-findall-column-sqli-facts/facts.json
only: reactpress-findall-column-sqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: reactpress-findall-column-sqli-final
task: agree-reactpress-findall-column-sqli
inputs:
pass_a: reactpress-findall-column-sqli-va/units.jsonl
pass_b: reactpress-findall-column-sqli-vb/units.jsonl
pass_c: reactpress-findall-column-sqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: unleash-addon-webhook-ssrf-vc
task: verify-c-unleash-addon-webhook-ssrf
dependsOn:
- unleash-addon-webhook-ssrf-agree
inputs:
facts: unleash-addon-webhook-ssrf-facts/facts.json
only: unleash-addon-webhook-ssrf-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: unleash-addon-webhook-ssrf-final
task: agree-unleash-addon-webhook-ssrf
inputs:
pass_a: unleash-addon-webhook-ssrf-va/units.jsonl
pass_b: unleash-addon-webhook-ssrf-vb/units.jsonl
pass_c: unleash-addon-webhook-ssrf-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: winml-cli-serve-cors-vc
task: verify-c-winml-cli-serve-cors
dependsOn:
- winml-cli-serve-cors-agree
inputs:
facts: winml-cli-serve-cors-facts/facts.json
only: winml-cli-serve-cors-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: winml-cli-serve-cors-final
task: agree-winml-cli-serve-cors
inputs:
pass_a: winml-cli-serve-cors-va/units.jsonl
pass_b: winml-cli-serve-cors-vb/units.jsonl
pass_c: winml-cli-serve-cors-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: wp-directorist-avatar-ssrf-vc
task: verify-c-wp-directorist-avatar-ssrf
dependsOn:
- wp-directorist-avatar-ssrf-agree
inputs:
facts: wp-directorist-avatar-ssrf-facts/facts.json
only: wp-directorist-avatar-ssrf-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.03
calls: 8
- name: wp-directorist-avatar-ssrf-final
task: agree-wp-directorist-avatar-ssrf
inputs:
pass_a: wp-directorist-avatar-ssrf-va/units.jsonl
pass_b: wp-directorist-avatar-ssrf-vb/units.jsonl
pass_c: wp-directorist-avatar-ssrf-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: wp-gopay-log-filter-sqli-vc
task: verify-c-wp-gopay-log-filter-sqli
dependsOn:
- wp-gopay-log-filter-sqli-agree
inputs:
facts: wp-gopay-log-filter-sqli-facts/facts.json
only: wp-gopay-log-filter-sqli-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.02
calls: 8
- name: wp-gopay-log-filter-sqli-final
task: agree-wp-gopay-log-filter-sqli
inputs:
pass_a: wp-gopay-log-filter-sqli-va/units.jsonl
pass_b: wp-gopay-log-filter-sqli-vb/units.jsonl
pass_c: wp-gopay-log-filter-sqli-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: wp-groundhogg-confirm-redirect-vc
task: verify-c-wp-groundhogg-confirm-redirect
dependsOn:
- wp-groundhogg-confirm-redirect-agree
inputs:
facts: wp-groundhogg-confirm-redirect-facts/facts.json
only: wp-groundhogg-confirm-redirect-agree/disputed.json
outputs:
- units.jsonl
- summary.json
budget:
usd: 0.05
calls: 8
- name: wp-groundhogg-confirm-redirect-final
task: agree-wp-groundhogg-confirm-redirect
inputs:
pass_a: wp-groundhogg-confirm-redirect-va/units.jsonl
pass_b: wp-groundhogg-confirm-redirect-vb/units.jsonl
pass_c: wp-groundhogg-confirm-redirect-vc/units.jsonl
outputs:
- agreed.json
- disputed.json
budget:
usd: 0
calls: 0
- name: budibase-mongo-template-nosqli-remember
task: remember-budibase-mongo-template-nosqli
inputs:
facts: budibase-mongo-template-nosqli-facts/facts.json
facts_summary: budibase-mongo-template-nosqli-facts/summary.json
pass_a: budibase-mongo-template-nosqli-va/units.jsonl
summary_a: budibase-mongo-template-nosqli-va/summary.json
pass_b: budibase-mongo-template-nosqli-vb/units.jsonl
summary_b: budibase-mongo-template-nosqli-vb/summary.json
pass_c: budibase-mongo-template-nosqli-vc/units.jsonl
summary_c: budibase-mongo-template-nosqli-vc/summary.json
agreed: budibase-mongo-template-nosqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: cct-studio-server-cmdi-remember
task: remember-cct-studio-server-cmdi
inputs:
facts: cct-studio-server-cmdi-facts/facts.json
facts_summary: cct-studio-server-cmdi-facts/summary.json
pass_a: cct-studio-server-cmdi-va/units.jsonl
summary_a: cct-studio-server-cmdi-va/summary.json
pass_b: cct-studio-server-cmdi-vb/units.jsonl
summary_b: cct-studio-server-cmdi-vb/summary.json
pass_c: cct-studio-server-cmdi-vc/units.jsonl
summary_c: cct-studio-server-cmdi-vc/summary.json
agreed: cct-studio-server-cmdi-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: contextforge-prompt-ssti-remember
task: remember-contextforge-prompt-ssti
inputs:
facts: contextforge-prompt-ssti-facts/facts.json
facts_summary: contextforge-prompt-ssti-facts/summary.json
pass_a: contextforge-prompt-ssti-va/units.jsonl
summary_a: contextforge-prompt-ssti-va/summary.json
pass_b: contextforge-prompt-ssti-vb/units.jsonl
summary_b: contextforge-prompt-ssti-vb/summary.json
pass_c: contextforge-prompt-ssti-vc/units.jsonl
summary_c: contextforge-prompt-ssti-vc/summary.json
agreed: contextforge-prompt-ssti-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: froxlor-admin-ip-second-order-sqli-remember
task: remember-froxlor-admin-ip-second-order-sqli
inputs:
facts: froxlor-admin-ip-second-order-sqli-facts/facts.json
facts_summary: froxlor-admin-ip-second-order-sqli-facts/summary.json
pass_a: froxlor-admin-ip-second-order-sqli-va/units.jsonl
summary_a: froxlor-admin-ip-second-order-sqli-va/summary.json
pass_b: froxlor-admin-ip-second-order-sqli-vb/units.jsonl
summary_b: froxlor-admin-ip-second-order-sqli-vb/summary.json
pass_c: froxlor-admin-ip-second-order-sqli-vc/units.jsonl
summary_c: froxlor-admin-ip-second-order-sqli-vc/summary.json
agreed: froxlor-admin-ip-second-order-sqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: fuxa-tdengine-escape-sqli-remember
task: remember-fuxa-tdengine-escape-sqli
inputs:
facts: fuxa-tdengine-escape-sqli-facts/facts.json
facts_summary: fuxa-tdengine-escape-sqli-facts/summary.json
pass_a: fuxa-tdengine-escape-sqli-va/units.jsonl
summary_a: fuxa-tdengine-escape-sqli-va/summary.json
pass_b: fuxa-tdengine-escape-sqli-vb/units.jsonl
summary_b: fuxa-tdengine-escape-sqli-vb/summary.json
pass_c: fuxa-tdengine-escape-sqli-vc/units.jsonl
summary_c: fuxa-tdengine-escape-sqli-vc/summary.json
agreed: fuxa-tdengine-escape-sqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: lmdeploy-media-url-ssrf-remember
task: remember-lmdeploy-media-url-ssrf
inputs:
facts: lmdeploy-media-url-ssrf-facts/facts.json
facts_summary: lmdeploy-media-url-ssrf-facts/summary.json
pass_a: lmdeploy-media-url-ssrf-va/units.jsonl
summary_a: lmdeploy-media-url-ssrf-va/summary.json
pass_b: lmdeploy-media-url-ssrf-vb/units.jsonl
summary_b: lmdeploy-media-url-ssrf-vb/summary.json
pass_c: lmdeploy-media-url-ssrf-vc/units.jsonl
summary_c: lmdeploy-media-url-ssrf-vc/summary.json
agreed: lmdeploy-media-url-ssrf-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: medplum-external-auth-open-redirect-remember
task: remember-medplum-external-auth-open-redirect
inputs:
facts: medplum-external-auth-open-redirect-facts/facts.json
facts_summary: medplum-external-auth-open-redirect-facts/summary.json
pass_a: medplum-external-auth-open-redirect-va/units.jsonl
summary_a: medplum-external-auth-open-redirect-va/summary.json
pass_b: medplum-external-auth-open-redirect-vb/units.jsonl
summary_b: medplum-external-auth-open-redirect-vb/summary.json
pass_c: medplum-external-auth-open-redirect-vc/units.jsonl
summary_c: medplum-external-auth-open-redirect-vc/summary.json
agreed: medplum-external-auth-open-redirect-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: pgadmin-maintenance-sqli-remember
task: remember-pgadmin-maintenance-sqli
inputs:
facts: pgadmin-maintenance-sqli-facts/facts.json
facts_summary: pgadmin-maintenance-sqli-facts/summary.json
pass_a: pgadmin-maintenance-sqli-va/units.jsonl
summary_a: pgadmin-maintenance-sqli-va/summary.json
pass_b: pgadmin-maintenance-sqli-vb/units.jsonl
summary_b: pgadmin-maintenance-sqli-vb/summary.json
pass_c: pgadmin-maintenance-sqli-vc/units.jsonl
summary_c: pgadmin-maintenance-sqli-vc/summary.json
agreed: pgadmin-maintenance-sqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: qwed-sympy-eval-remember
task: remember-qwed-sympy-eval
inputs:
facts: qwed-sympy-eval-facts/facts.json
facts_summary: qwed-sympy-eval-facts/summary.json
pass_a: qwed-sympy-eval-va/units.jsonl
summary_a: qwed-sympy-eval-va/summary.json
pass_b: qwed-sympy-eval-vb/units.jsonl
summary_b: qwed-sympy-eval-vb/summary.json
pass_c: qwed-sympy-eval-vc/units.jsonl
summary_c: qwed-sympy-eval-vc/summary.json
agreed: qwed-sympy-eval-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: reactpress-findall-column-sqli-remember
task: remember-reactpress-findall-column-sqli
inputs:
facts: reactpress-findall-column-sqli-facts/facts.json
facts_summary: reactpress-findall-column-sqli-facts/summary.json
pass_a: reactpress-findall-column-sqli-va/units.jsonl
summary_a: reactpress-findall-column-sqli-va/summary.json
pass_b: reactpress-findall-column-sqli-vb/units.jsonl
summary_b: reactpress-findall-column-sqli-vb/summary.json
pass_c: reactpress-findall-column-sqli-vc/units.jsonl
summary_c: reactpress-findall-column-sqli-vc/summary.json
agreed: reactpress-findall-column-sqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: unleash-addon-webhook-ssrf-remember
task: remember-unleash-addon-webhook-ssrf
inputs:
facts: unleash-addon-webhook-ssrf-facts/facts.json
facts_summary: unleash-addon-webhook-ssrf-facts/summary.json
pass_a: unleash-addon-webhook-ssrf-va/units.jsonl
summary_a: unleash-addon-webhook-ssrf-va/summary.json
pass_b: unleash-addon-webhook-ssrf-vb/units.jsonl
summary_b: unleash-addon-webhook-ssrf-vb/summary.json
pass_c: unleash-addon-webhook-ssrf-vc/units.jsonl
summary_c: unleash-addon-webhook-ssrf-vc/summary.json
agreed: unleash-addon-webhook-ssrf-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: winml-cli-serve-cors-remember
task: remember-winml-cli-serve-cors
inputs:
facts: winml-cli-serve-cors-facts/facts.json
facts_summary: winml-cli-serve-cors-facts/summary.json
pass_a: winml-cli-serve-cors-va/units.jsonl
summary_a: winml-cli-serve-cors-va/summary.json
pass_b: winml-cli-serve-cors-vb/units.jsonl
summary_b: winml-cli-serve-cors-vb/summary.json
pass_c: winml-cli-serve-cors-vc/units.jsonl
summary_c: winml-cli-serve-cors-vc/summary.json
agreed: winml-cli-serve-cors-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: wp-directorist-avatar-ssrf-remember
task: remember-wp-directorist-avatar-ssrf
inputs:
facts: wp-directorist-avatar-ssrf-facts/facts.json
facts_summary: wp-directorist-avatar-ssrf-facts/summary.json
pass_a: wp-directorist-avatar-ssrf-va/units.jsonl
summary_a: wp-directorist-avatar-ssrf-va/summary.json
pass_b: wp-directorist-avatar-ssrf-vb/units.jsonl
summary_b: wp-directorist-avatar-ssrf-vb/summary.json
pass_c: wp-directorist-avatar-ssrf-vc/units.jsonl
summary_c: wp-directorist-avatar-ssrf-vc/summary.json
agreed: wp-directorist-avatar-ssrf-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: wp-gopay-log-filter-sqli-remember
task: remember-wp-gopay-log-filter-sqli
inputs:
facts: wp-gopay-log-filter-sqli-facts/facts.json
facts_summary: wp-gopay-log-filter-sqli-facts/summary.json
pass_a: wp-gopay-log-filter-sqli-va/units.jsonl
summary_a: wp-gopay-log-filter-sqli-va/summary.json
pass_b: wp-gopay-log-filter-sqli-vb/units.jsonl
summary_b: wp-gopay-log-filter-sqli-vb/summary.json
pass_c: wp-gopay-log-filter-sqli-vc/units.jsonl
summary_c: wp-gopay-log-filter-sqli-vc/summary.json
agreed: wp-gopay-log-filter-sqli-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0
- name: wp-groundhogg-confirm-redirect-remember
task: remember-wp-groundhogg-confirm-redirect
inputs:
facts: wp-groundhogg-confirm-redirect-facts/facts.json
facts_summary: wp-groundhogg-confirm-redirect-facts/summary.json
pass_a: wp-groundhogg-confirm-redirect-va/units.jsonl
summary_a: wp-groundhogg-confirm-redirect-va/summary.json
pass_b: wp-groundhogg-confirm-redirect-vb/units.jsonl
summary_b: wp-groundhogg-confirm-redirect-vb/summary.json
pass_c: wp-groundhogg-confirm-redirect-vc/units.jsonl
summary_c: wp-groundhogg-confirm-redirect-vc/summary.json
agreed: wp-groundhogg-confirm-redirect-final/agreed.json
outputs:
- memory.jsonl
budget:
usd: 0
calls: 0