Marius CiepluchandClaude Opus 4.8 b59dd651d8 unseen: resilient draw -- a bad repo skips, a broken instrument aborts ...

Individual repositories in the advisory population raise per-candidate
extract.InstrumentFailure during extraction (git_exit_128 on an
unfetchable fix commit, clone_size_cap, and others), and each one
aborted the whole 300-repo draft. The draw is healthy; one bad repo
should not reset it.

extract_repository now also catches extract.InstrumentFailure and
OSError and records them as "extract_<reason>" rejections, so the draw
skips that repo and continues (the reason, e.g. extract_git_exit_128,
shows in the rejections counter). ExtractionTimeout keeps its existing
extraction_timeout skip; any other exception still propagates as a real
abort, so genuine code bugs are not masked.

A systemic guard preserves the instrument rule: run() raises
InstrumentFailure("systemic_extraction_failure") if 25 extraction
attempts fail with zero successes (e.g. git missing, auth broken) or if
extraction failures exceed 200 overall. A handful of bad repos with many
successes never trips it.

190 unseen tests pass, ruff clean.

Co-Authored-By: Claude Opus 4.8 <[email protected]>

2026-10-08 17:19:36 +02:00

..

fixtures

search-with-proof: probe harness (3.2) and agent worker (group 5)

2026-10-05 14:45:48 +02:00

golden

feat(gate): Phase 4 task 8 — lock the detection gate into CI

2026-06-22 17:13:02 +02:00

conftest.py

plane(1.2): literals out of doctor, egress, router, generate -- the profile is handed in

2026-10-02 20:26:46 +02:00

learn_fixtures.py

feat(learn): the classifier program and its response cache (decision-engine 6.4)

2026-10-01 10:13:31 +02:00

plane_fake_store.py

plane(2.1): Delivery -- presigned store URLs, collection, state mirrored to the store

2026-10-02 21:05:48 +02:00

plane_stub_task.py

feat(plane): router-addressed start signal; credentials only in the start request

2026-09-29 19:41:35 +02:00

test_advisory_fix_pairs.py

learn: 251 more advisory-fix pairs whose function survives the fix (advisory-fixes-3)

2026-10-04 11:57:34 +02:00

test_agent_skills.py

chore(skills): apply the 2026-10-02 review -- current CLI and evidence, merges, removals, steering names

2026-10-02 19:48:01 +02:00

test_ax_batch.py

search-with-proof: split compressed verifier archives, isolated pip installs, verifier module paths

2026-10-06 11:15:09 +02:00

test_ax_executor.py

tests: a timed-out AX attempt may carry its reason instead of None [skip ci]

2026-10-06 14:51:07 +02:00

test_ax_lean.py

ops(kind): skip Substrate's observability stack by default (930 MiB of 2.3 GB); opt in with OUSAST_KIND_OBSERVABILITY=1

2026-10-04 12:03:19 +02:00

test_benchmark.py

feat(ruleset): PHP quick-mode rules from the engine's vocabulary, measured on the development corpus

2026-09-30 15:05:47 +02:00

test_calibration.py

ci: add quality gates and release workflows

2026-06-18 10:06:21 +02:00

test_candidate_enumeration.py

feat(model-grounded-detection): group 1, subtract the noise architecture

2026-09-08 12:15:54 +02:00

test_cli_improve.py

feat(pair-corpus-honesty): reject improve rounds that regress any provenance profile on holdout

2026-09-05 10:45:43 +02:00

test_complexity_hints.py

feat(three-stage-scan): attach test-gap hints to hotspots

2026-09-03 20:33:48 +02:00

test_complexity_ledger.py

feat(three-stage-scan): report map and honor fail-on worth-fixing

2026-09-04 00:18:33 +02:00

test_complexity_map.py

feat(three-stage-scan): attach test-gap hints to hotspots

2026-09-03 20:33:48 +02:00

test_complexity_signals.py

feat(three-stage-scan): compute complexity signals for hotspot ranking

2026-09-03 20:05:13 +02:00

test_config.py

chore(config): retire unread keys [sandbox] network, [sandbox] workspace_readonly, [complexity] top_k

2026-10-02 19:45:37 +02:00

test_cpg_backend.py

fix(scan): report requests the reserve held back as unasked, not failed

2026-09-23 08:51:12 +02:00

test_cpg_budget.py

test(cpg-budget): a process vanishing mid-read is the success case too

2026-09-26 07:44:33 +02:00

test_cpg_queries_compile.py

fix(cpg): null-guard method access in the query scripts -- a class-level call aborted the whole taint batch

2026-10-03 22:53:28 +02:00

test_cpg_session.py

engine: one resident Joern session per pin (frontend + one query JVM instead of four), ActiveProcessorCount=2 on the cluster

2026-10-04 16:41:22 +02:00

test_degradation_matrix.py

feat(model-grounded-detection): group 1, subtract the noise architecture

2026-09-08 12:15:54 +02:00

test_detection_benchmarks.py

feat(gate): Phase 4 task 8 — lock the detection gate into CI

2026-06-22 17:13:02 +02:00

test_dispatch_value.py

fix(mapping): record every callback of a register_rest_route call as a route

2026-09-24 11:08:22 +02:00

test_docs_site.py

refactor(memory): S3-generic store on boto3; RustFS is the tested server (no MinIO naming)

2026-10-02 10:15:19 +02:00

test_engine_queue.py

engine: stage presigned objects as .dat; task entry reports the failing step and HTTP status

2026-10-04 16:18:01 +02:00

test_engine_task_entry.py

engine: one resident Joern session per pin (frontend + one query JVM instead of four), ActiveProcessorCount=2 on the cluster

2026-10-04 16:41:22 +02:00

test_engine_trace.py

unseen-eval: calibrated replay deadline + native agreement check, docker-lane diagnostics, proof 4.4 record; engine runner cleans up fetched sources

2026-10-05 08:14:57 +02:00

test_fact_memo.py

perf(push): find the Python-side scale walls all at once, and remove them

2026-09-23 19:36:32 +02:00

test_findings.py

feat(ruleset): Phase 2 (task 3) — rules as governed data, severity from policy

2026-06-22 15:27:16 +02:00

test_frontend_retention.py

fix(contributor-scan): retain declared Gruntfile and report census gaps honestly

2026-09-14 08:07:06 +02:00

test_fusion.py

refactor(harnessx-removal): retire the HarnessX scan paths (task 5)

2026-09-30 12:13:26 +02:00

test_gate.py

chore: remove dead modules (judge, execution, calibrate, stage_processors, slot_contract)

2026-10-02 07:22:35 +02:00

test_gitignore_semantics.py

fix(preprocess): read .gitignore with git's semantics; never ignore a tracked file

2026-09-25 15:29:43 +02:00

test_graph_reuse.py

feat(pre-push-safety-net): reuse compatible artifacts throughout replay

2026-09-13 17:08:49 +02:00

test_hardening_pipeline.py

feat(hardening): Phase 15 — redaction, retry/backoff, budgets, threat-model docs

2026-06-22 20:02:34 +02:00

test_harness.py

ci: add quality gates and release workflows

2026-06-18 10:06:21 +02:00

test_hunter_curated_tools.py

fix(hunter): ask for the final answer in plain text; DeepSeek's JSON mode lost it

2026-09-28 20:10:57 +02:00

test_hunter_tools.py

fix(hunter): bound every tool result; show the provider's reason for an HTTP error

2026-09-28 20:15:14 +02:00

test_hunter.py

feat(hunter): add standard-mode scheduling

2026-06-18 10:59:25 +02:00

test_improve_memory.py

feat(plane): honest coverage in alerts; PHP alerts from the engine on the host

2026-09-30 13:44:32 +02:00

test_improve.py

feat(pair-corpus-honesty): score non-vendored pointer pairs through a local cache

2026-09-05 10:45:43 +02:00

test_independent_freeze.py

bench(independent): freeze population v3 (PHP)

2026-09-30 18:15:52 +02:00

test_independent_population.py

unseen-eval group 1: used set (1,029 repositories, every source read), extended guard, usage ledger; record 01

2026-10-04 19:17:35 +02:00

test_index.py

chore(index): remove the unused vector index, the ousast index subcommand and the [embeddings] section

2026-10-02 19:32:46 +02:00

test_joern_leak_audit.py

merge(engine): Kubernetes engine workers (Deployment from the image, S3 queue); leak-audit records carry digests, not repository names

2026-10-04 14:39:36 +02:00

test_layout_facts.py

feat(ruleset): tag framework-specific knowledge as optional priors (decision-engine task 2)

2026-09-30 18:49:05 +02:00

test_learn_build_features.py

learn: build_features reads v2 _a/_b scans and TypeScript repository-scan witnesses; --dry-run

2026-10-03 14:41:55 +02:00

test_learn_calibrate.py

feat(learn): compile, calibrate, evaluate (decision-engine 6.5)

2026-10-01 10:36:34 +02:00

test_learn_compile.py

refactor(memory): S3-generic store on boto3; RustFS is the tested server (no MinIO naming)

2026-10-02 10:15:19 +02:00

test_learn_decide.py

feat(learn): compile, calibrate, evaluate (decision-engine 6.5)

2026-10-01 10:36:34 +02:00

test_learn_embeddings.py

refactor(memory): S3-generic store on boto3; RustFS is the tested server (no MinIO naming)

2026-10-02 10:15:19 +02:00

test_learn_examples.py

fix(learn): example rows drop another profile's null features when written and read

2026-10-02 17:24:49 +02:00

test_learn_excerpt.py

fix(learn): excerpt matcher covers more declaration forms

2026-10-02 16:12:08 +02:00

test_learn_experiments.py

learn: exp-005 graph slice -- slice in the prompt (opt-in), program-arm fill, manifest and units

2026-10-03 15:06:08 +02:00

test_learn_fill.py

learn: exp-005 graph slice -- slice in the prompt (opt-in), program-arm fill, manifest and units

2026-10-03 15:06:08 +02:00

test_learn_folds.py

feat(learn): retrieval and the evaluation boundary (decision-engine 6.3)

2026-10-01 10:05:19 +02:00

test_learn_labels.py

fix(learn): fixed-side negatives only where the fixed side declares the function

2026-10-01 11:03:54 +02:00

test_learn_leaks.py

fix(learn): v1 withholds verify.flag_b and ms.operation (plane-profile leak audit)

2026-10-02 15:25:21 +02:00

test_learn_program.py

bench(learn): injection first slice -- compiled AI classifier, out-of-repo evaluation (decision-engine 6.2, 6.6)

2026-10-01 20:40:41 +02:00

test_learn_retrieve.py

bench(learn): slice 2 -- six families out-of-repo

2026-10-02 11:33:16 +02:00

test_learn_roles.py

bench(learn): harvest signals for the decision engine (decision-engine task 5)

2026-10-01 14:04:28 +02:00

test_learn_rules.py

learn(exp-004): Req 6.4 pooled BLOCK gate with a family floor; manifest before units

2026-10-03 09:40:58 +02:00

test_learn_schema.py

feat(learn): candidate feature schema and builders (decision-engine task 1)

2026-09-30 18:38:04 +02:00

test_learn_slice.py

merge(engine): Kubernetes engine workers (Deployment from the image, S3 queue); leak-audit records carry digests, not repository names

2026-10-04 14:39:36 +02:00

test_map_gate.py

feat(three-stage-scan): gate stage-2 maps against split-sink ranking

2026-09-04 11:53:06 +02:00

test_mapping.py

fix(mapping): a PHP method with a visibility modifier is a region

2026-09-09 17:33:36 +02:00

test_mcp.py

feat(mcp): the findings list carries the rung, and leads with what was decided

2026-09-09 13:15:54 +02:00

test_model_change_context.py

fix(scan): symlink, unsupported-language and unparsed-file gaps are owned by what they name

2026-09-25 14:30:36 +02:00

test_model_config_value.py

fix(config): report every permissive setting in a file, not the first one

2026-09-20 16:30:04 +02:00

test_model_dominance.py

feat(model): an access-control finding names a line, and what the PDG does not give us

2026-09-09 13:09:47 +02:00

test_model_endpoint.py

spec(pre-push-safety-net): pre-register the hunter experiment on population v2

2026-09-28 09:10:02 +02:00

test_model_evidence.py

feat(model): shipped joins the evidence vector as a within-tier weight; v5 baseline

2026-09-11 13:45:00 +02:00

test_model_ladder.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_model_partitions.py

fix(contributor-scan): retain declared Gruntfile and report census gaps honestly

2026-09-14 08:07:06 +02:00

test_model_pipeline.py

feat(model): a region that spans the flow, not just a function

2026-09-09 09:27:19 +02:00

test_model_regions.py

fix(ranker): scope a region to the file that defines its handler (M1b 12.4)

2026-09-17 14:04:39 +02:00

test_model_report.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_model_scan_stage.py

feat(contributor-scan): 1.3 the model layer reaches a user

2026-09-09 07:42:44 +02:00

test_model_scan.py

fix(contributor-scan): retain declared Gruntfile and report census gaps honestly

2026-09-14 08:07:06 +02:00

test_model_scope.py

fix(scan,taint): TypeScript's limit is owned by TypeScript; a source pattern is a token

2026-09-25 15:13:30 +02:00

test_model_shipped.py

feat(model): let the project say what it ships, and rank that first

2026-09-09 12:45:21 +02:00

test_model_specs.py

feat(repos): a WordPress plugin with a verified CVE, and the WordPress DB API

2026-09-09 16:13:17 +02:00

test_model_taint.py

feat(model): one finding per sink site, and WordPress's registration model

2026-09-09 14:30:48 +02:00

test_model_taxonomy.py

feat(reports): say what was looked for, and what cannot be decided

2026-09-09 15:08:01 +02:00

test_module_audit.py

chore: remove dead modules (judge, execution, calibrate, stage_processors, slot_contract)

2026-10-02 07:22:35 +02:00

test_mutation_fixtures.py

feat(three-stage-scan): add aliased-sink mutation the regex scan misses

2026-09-04 11:50:44 +02:00

test_obligation_check.py

feat(model-grounded-detection): group 1, subtract the noise architecture

2026-09-08 12:15:54 +02:00

test_obligation_dominance.py

feat(authorization-obligations): Dominance protocol with an order-based default

2026-09-05 19:38:04 +02:00

test_obligation_facts.py

feat(authorization-obligations): group sibling handlers and find consistency anomalies

2026-09-06 07:24:13 +02:00

test_obligation_intent.py

feat(authorization-obligations): hunter adjudicates intent without raising evidence

2026-09-06 07:24:13 +02:00

test_obligation_operations.py

feat(learning-harness): declared twins and a fixture-difficulty check

2026-09-06 13:09:56 +02:00

test_obligation_policy.py

feat(authorization-obligations): group sibling handlers and find consistency anomalies

2026-09-06 07:24:13 +02:00

test_obligation_reports.py

feat(authorization-obligations): reports and ranking name the obligation

2026-09-06 07:24:13 +02:00

test_obligation_scan.py

feat(authorization-obligations): run the checker in MAP with config and manifest counters

2026-09-06 07:24:13 +02:00

test_obligation_shapes.py

feat(authorization-obligations): obligation shapes derived from trusted pairs

2026-09-05 19:38:04 +02:00

test_obligation_siblings.py

feat(authorization-obligations): group sibling handlers and find consistency anomalies

2026-09-06 07:24:13 +02:00

test_pair_corpus.py

feat(model-grounded-detection): group 1, subtract the noise architecture

2026-09-08 12:15:54 +02:00

test_pair_harvest.py

feat(authorization-obligations): harvest mode handler_context and the obligation label

2026-09-06 07:24:13 +02:00

test_pair_hygiene.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_pair_registration_context.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_php_quick_rules.py

feat(ruleset): tag framework-specific knowledge as optional priors (decision-engine task 2)

2026-09-30 18:49:05 +02:00

test_pipeline_calibration.py

feat(calibration): automatic in-pipeline false-positive feedback

2026-06-21 20:44:08 +02:00

test_plane_ax_live.py

fix(plane): ax task lifecycle -- resume, stay-up runner, delivery as completion

2026-09-29 19:04:52 +02:00

test_plane_budget.py

feat(plane): budget metering (task 2)

2026-09-29 17:41:09 +02:00

test_plane_delivery.py

plane(2.4): reconciler on Delivery -- the start body carries the URLs, the store completes the task

2026-10-02 21:49:58 +02:00

test_plane_egress.py

plane(2.3): egress -- one TLS rule over store host, Git hosts and Model hosts; no http rule

2026-10-02 21:29:32 +02:00

test_plane_engine_alerts.py

feat(ruleset): PHP quick-mode rules from the engine's vocabulary, measured on the development corpus

2026-09-30 15:05:47 +02:00

test_plane_features.py

feat(learn): candidate feature schema and builders (decision-engine task 1)

2026-09-30 18:38:04 +02:00

test_plane_harvest.py

fix(learn): withhold label-tracking signals from the v1 classifier; leak audit

2026-10-01 19:40:58 +02:00

test_plane_increment.py

plane(1.4): up.sh by profile -- context, registry, pool and images file from kind.toml

2026-10-02 20:43:40 +02:00

test_plane_literals.py

plane(1.3): host-literal scan test over src, plane, ops and docs

2026-10-02 20:32:51 +02:00

test_plane_loop.py

feat(learn): candidate feature schema and builders (decision-engine task 1)

2026-09-30 18:38:04 +02:00

test_plane_manifests.py

feat(learn): metered embeddings and the cache (decision-engine 6.2)

2026-10-01 09:56:52 +02:00

test_plane_memory.py

refactor(memory): S3-generic store on boto3; RustFS is the tested server (no MinIO naming)

2026-10-02 10:15:19 +02:00

test_plane_profile.py

ops(kind): skip Substrate's observability stack by default (930 MiB of 2.3 GB); opt in with OUSAST_KIND_OBSERVABILITY=1

2026-10-04 12:03:19 +02:00

test_plane_reconciler.py

plane(2.4): reconciler on Delivery -- the start body carries the URLs, the store completes the task

2026-10-02 21:49:58 +02:00

test_plane_remember.py

feat(plane): honest coverage in alerts; PHP alerts from the engine on the host

2026-09-30 13:44:32 +02:00

test_plane_repo_facts.py

feat(plane): repo-facts memory task (task 5)

2026-09-29 17:55:34 +02:00

test_plane_router.py

plane(1.2): literals out of doctor, egress, router, generate -- the profile is handed in

2026-10-02 20:26:46 +02:00

test_plane_runner.py

plane(2.2): runner -- delivery {put, inputs} in the start body, PUT to the store

2026-10-02 21:12:19 +02:00

test_plane_scoring_parity.py

chore(bench): archive reference-only scripts

2026-10-02 08:07:35 +02:00

test_plane_tiebreak.py

feat(plane): tie-break pass on disputed candidates; 2-of-3 agreement

2026-09-30 08:19:46 +02:00

test_plane_verify.py

feat(plane): scoring parity with the reference -- sites, ranges, triage cost

2026-09-29 19:49:28 +02:00

test_policy.py

feat(governance): Phase 1 — CWE policy store + project score (zero-dep)

2026-06-22 12:31:35 +02:00

test_preprocess.py

feat(scan): add initial SAST pipeline

2026-06-17 21:13:51 +02:00

test_profiling.py

perf(push): drop per-entry cache fsync; let long runs profile themselves

2026-09-23 19:05:08 +02:00

test_provenance.py

feat(pair-corpus-honesty): deterministic provenance fingerprint at scan time

2026-09-05 10:45:43 +02:00

test_provider_retry.py

fix: a body that stops mid-read is transient, and a round that dies still says so

2026-09-07 07:37:41 +02:00

test_push_admission.py

fix(pre-push-safety-net): take the operation symbol from the call (M1b 12.1)

2026-09-17 09:56:59 +02:00

test_push_assistance.py

feat(pre-push-safety-net): bound optional assistance to admitted witnesses

2026-09-13 18:03:31 +02:00

test_push_background.py

pre-push(17.5): say when the engine cannot finish, and offer it in the background

2026-10-02 22:31:14 +02:00

test_push_cache_semantics.py

feat(pre-push-safety-net): key evidence reuse by compatible semantics

2026-09-13 16:16:19 +02:00

test_push_cache.py

fix(push): stop rescanning the whole cache on every publication

2026-09-23 14:12:47 +02:00

test_push_contracts.py

feat(pre-push-safety-net): retain bounded change and rename context

2026-09-12 21:12:45 +02:00

test_push_eligibility.py

feat(pre-push-safety-net): enforce evidence eligibility and record blocked qualification

2026-09-13 19:32:43 +02:00

test_push_experiment.py

feat(pre-push-safety-net): measure frozen PMPro and Node replay feasibility

2026-09-13 15:24:06 +02:00

test_push_explain.py

pre-push(17.6): install, Docker wrapper and first-run docs

2026-10-02 22:51:22 +02:00

test_push_feasibility.py

feat(pre-push-safety-net): measure frozen runtime feasibility and retain no-go

2026-09-13 19:06:02 +02:00

test_push_hook.py

pre-push(17.1): never block a push the user did not choose to block

2026-10-02 21:57:42 +02:00

test_push_inputs.py

feat(pre-push-safety-net): pin labeled evaluation inputs

2026-09-12 18:45:54 +02:00

test_push_install.py

pre-push(17.6): install, Docker wrapper and first-run docs

2026-10-02 22:51:22 +02:00

test_push_interface.py

feat(pre-push-safety-net): execute full Git push transactions

2026-09-13 17:45:16 +02:00

test_push_new_file.py

pre-push(17.4): a file new in head is new, not comparison unknown

2026-10-02 22:24:24 +02:00

test_push_policy.py

fix(push): a gap from another language partition no longer blocks admission

2026-09-21 13:50:38 +02:00

test_push_quick.py

pre-push(17.3): quick rules as the fast first tier

2026-10-02 22:18:14 +02:00

test_push_regression_integration.py

feat(pre-push-safety-net): cover combined push failure paths

2026-09-13 18:43:13 +02:00

test_push_report.py

feat(pre-push-safety-net): render bounded reports and preserve full evidence

2026-09-13 13:25:44 +02:00

test_push_reuse.py

feat(scan): size portions from measured per-answer cost and isolate the kill culprit

2026-09-23 07:55:33 +02:00

test_push_runner.py

feat(pre-push-safety-net): reuse compatible artifacts throughout replay

2026-09-13 17:08:49 +02:00

test_push_scoring.py

feat(pre-push-safety-net): preserve uncertainty in benchmark scoring

2026-09-12 19:04:20 +02:00

test_push_snapshot.py

feat(pre-push-safety-net): retain bounded change and rename context

2026-09-12 21:12:45 +02:00

test_push_vetoes.py

pre-push(17.1): never block a push the user did not choose to block

2026-10-02 21:57:42 +02:00

test_rank.py

feat(harness): add runtime and reachability mapping

2026-06-18 07:57:06 +02:00

test_redaction.py

feat(hardening): Phase 15 — redaction, retry/backoff, budgets, threat-model docs

2026-06-22 20:02:34 +02:00

test_regress_candidates.py

feat(three-stage-scan): select bounded regress candidates with sev-5 extras

2026-09-03 22:36:02 +02:00

test_regress_recipes.py

feat(three-stage-scan): add language recipes with inconclusive fallback

2026-09-03 22:48:10 +02:00

test_regress_safety.py

feat(three-stage-scan): reject unsafe regression snippets before execution

2026-09-03 22:12:45 +02:00

test_regress_verdicts.py

feat(three-stage-scan): map sandbox outcomes to worth-fixing verdicts

2026-09-03 22:59:01 +02:00

test_removed_plane_references.py

docs(harnessx-removal): the plane replaces HarnessX in README, docs and specs (task 8)

2026-09-30 12:45:29 +02:00

test_reports.py

pre-push(17.2): name every skipped check in plain words

2026-10-02 22:10:33 +02:00

test_repos.py

feat(repos): pinned known-vulnerable checkouts, offline by default

2026-09-09 08:10:59 +02:00

test_ruleset.py

feat(ruleset): tag framework-specific knowledge as optional priors (decision-engine task 2)

2026-09-30 18:49:05 +02:00

test_run.py

feat(scan): add initial SAST pipeline

2026-06-17 21:13:51 +02:00

test_sandbox_probe.py

feat(three-stage-scan): run or skip deep regression with visible degradation

2026-09-03 23:43:15 +02:00

test_sandbox_runner.py

feat(three-stage-scan): run or skip deep regression with visible degradation

2026-09-03 23:43:15 +02:00

test_scan_deep.py

refactor(harnessx-removal): retire the HarnessX scan paths (task 5)

2026-09-30 12:13:26 +02:00

test_scan_pipeline_integrity.py

refactor(harnessx-removal): retire the HarnessX scan paths (task 5)

2026-09-30 12:13:26 +02:00

test_score_pipeline.py

feat(ruleset): Phase 2 (task 3) — rules as governed data, severity from policy

2026-06-22 15:27:16 +02:00

test_scoring.py

feat(benchmark): Phase 2 (task 4) — actionable per-rule signals, ledger, FP knob

2026-06-22 15:41:17 +02:00

test_search_board.py

search-with-proof: family-to-oracle mapping, build memory, tolerant tool calls

2026-10-05 21:07:58 +02:00

test_search_browser.py

search-with-proof group 4 + image: board, spend reservation, coordinator, search-task image

2026-10-05 14:26:43 +02:00

test_search_budget.py

search-with-proof group 4 + image: board, spend reservation, coordinator, search-task image

2026-10-05 14:26:43 +02:00

test_search_control.py

search-with-proof: positive control for path oracle — honest serve signal, no false negatives

2026-10-06 17:07:24 +02:00

test_search_coordinator.py

search-with-proof: feed the control signal back to the agent (served-root hint)

2026-10-07 12:03:45 +02:00

test_search_demo_replay.py

search-with-proof: no-model demo replay (executor + verifier on a stored demo)

2026-10-06 14:50:14 +02:00

test_search_demo.py

search-with-proof: one interpreter for pip and apps; checkout root on sys.path; real node_modules path

2026-10-06 14:37:58 +02:00

test_search_executor_smoke.py

search-with-proof: split compressed verifier archives, isolated pip installs, verifier module paths

2026-10-06 11:15:09 +02:00

test_search_executor.py

search-with-proof: reproducible npm builds for old lockless projects (--before commit date)

2026-10-07 13:37:23 +02:00

test_search_image.py

images: shared task base, code-last layers, no per-push rebuilds [skip ci]

2026-10-05 20:40:13 +02:00

test_search_isolation.py

search-with-proof: declarative demos, brain/executor split, kube-ax constraints

2026-10-05 17:12:46 +02:00

test_search_pilot_run.py

search-with-proof: feed the control signal back to the agent (served-root hint)

2026-10-07 12:03:45 +02:00

test_search_pilot_select.py

search-with-proof: executor smoke driver and pilot selection (6.1)

2026-10-05 17:26:06 +02:00

test_search_probe.py

search-with-proof: ecosystem-aware build recipes and stderr in build failures

2026-10-05 21:37:56 +02:00

test_search_task_storage.py

search-with-proof: one interpreter for pip and apps; checkout root on sys.path; real node_modules path

2026-10-06 14:37:58 +02:00

test_search_verify_transport.py

search-with-proof: split compressed verifier archives, isolated pip installs, verifier module paths

2026-10-06 11:15:09 +02:00

test_search_verify.py

search-with-proof: oracle placeholders for demos; Python apps run under the venv interpreter

2026-10-06 12:43:11 +02:00

test_search_worker.py

search-with-proof: readiness from the budget with a probe, 4096-token tool turns, 40-step tasks

2026-10-06 09:37:47 +02:00

test_semantic_cst.py

feat(tree-sitter-overlay-extra): parse JS/C/Java overlay via optional extra

2026-09-04 15:07:35 +02:00

test_semantic_extra.py

chore(harnessx-removal): delete HarnessX code and packaging (task 6)

2026-09-30 12:18:42 +02:00

test_semantic_overlay.py

feat(tree-sitter-overlay-extra): parse JS/C/Java overlay via optional extra

2026-09-04 15:07:35 +02:00

test_semantic_pipeline.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_semantic_priors.py

feat(ruleset): tag framework-specific knowledge as optional priors (decision-engine task 2)

2026-09-30 18:49:05 +02:00

test_skills.py

feat(skills): Phase 14 — Trail of Bits skill index + router

2026-06-22 19:51:04 +02:00

test_split_sink_fixtures.py

feat(three-stage-scan): add split-sink fixtures the regex scan misses

2026-09-04 11:49:44 +02:00

test_split_sink_regress.py

feat(three-stage-scan): prove split-sink triggerable in sandbox

2026-09-04 11:54:01 +02:00

test_stages.py

feat(three-stage-scan): keep quick as stage-1 inventory

2026-09-03 23:14:00 +02:00

test_subtraction_complete.py

fix(ci): run ruff format, and record run 5 at 90% pair-correct

2026-09-08 19:46:58 +02:00

test_task_images.py

images: shared task base, code-last layers, no per-push rebuilds [skip ci]

2026-10-05 20:40:13 +02:00

test_tool_hunter.py

refactor(harnessx-removal): retire the HarnessX scan paths (task 5)

2026-09-30 12:13:26 +02:00

test_typescript_grammar.py

feat(learning-harness): absence rows travel with their registration

2026-09-06 12:39:55 +02:00

test_unseen_calibrate.py

unseen-eval: calibrated replay deadline + native agreement check, docker-lane diagnostics, proof 4.4 record; engine runner cleans up fetched sources

2026-10-05 08:14:57 +02:00

test_unseen_draft.py

unseen: resilient draw -- a bad repo skips, a broken instrument aborts

2026-10-08 17:19:36 +02:00

test_unseen_eligibility.py

unseen-eval group 1: used set (1,029 repositories, every source read), extended guard, usage ledger; record 01

2026-10-04 19:17:35 +02:00

test_unseen_extract.py

unseen: bound per-repo extraction time; a slow repo skips, never aborts

2026-10-08 13:22:22 +02:00

test_unseen_image.py

unseen-eval groups 4-6: generic AX batch dispatcher (engine_trace on it), replay task and image stage, scorer with adoption gate

2026-10-04 20:19:14 +02:00

test_unseen_ledger.py

unseen-eval group 1: used set (1,029 repositories, every source read), extended guard, usage ledger; record 01

2026-10-04 19:17:35 +02:00

test_unseen_proof.py

unseen-eval: calibrated replay deadline + native agreement check, docker-lane diagnostics, proof 4.4 record; engine runner cleans up fetched sources

2026-10-05 08:14:57 +02:00

test_unseen_replay_entry.py

unseen-eval groups 4-6: generic AX batch dispatcher (engine_trace on it), replay task and image stage, scorer with adoption gate

2026-10-04 20:19:14 +02:00

test_unseen_replay.py

unseen-eval groups 4-6: generic AX batch dispatcher (engine_trace on it), replay task and image stage, scorer with adoption gate

2026-10-04 20:19:14 +02:00

test_unseen_score.py

unseen-eval groups 4-6: generic AX batch dispatcher (engine_trace on it), replay task and image stage, scorer with adoption gate

2026-10-04 20:19:14 +02:00

test_unseen_source.py

unseen: cursor pagination for advisory enumeration

2026-10-08 10:26:11 +02:00

test_verification.py

ci: add quality gates and release workflows

2026-06-18 10:06:21 +02:00