marius/Open_Ultra_SAST
1
0
Fork 0
mirror of https://github.com/norandom/OpenUltraSAST.git synced 2026-10-16 03:49:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e39a4882b09da8a7481b549070137c1b888488cb
Open_Ultra_SAST/benchmarks
T
History
Marius CiepluchandClaude Opus 5.5 e39a4882b0 search-with-proof: bootstrap intent, real reason/explore contracts, visible refusals 
First live run: the reason step got ~190 tokens and returned {} -> silent
no_evidence. Now: a bootstrap intent reads the candidate and its entry point; the
reason prompt states the goal, family oracles, demo schema and must propose
intents when none are open; empty replies retry once then end as reason_refused;
failure records keep messages.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-05 19:18:12 +02:00
..
archive
ci: green again -- format and lint the whole tree; push the scan and runner images to GHCR on tags
2026-10-02 20:09:28 +02:00
ax
search-with-proof: diagnosable failures, pip install race, no duplicate tasks
2026-10-05 17:58:27 +02:00
dev
ci: green again -- format and lint the whole tree; push the scan and runner images to GHCR on tags
2026-10-02 20:09:28 +02:00
experiments
learn: exp-005 graph slice -- inconclusive (within-pair AUC 0.762 -> 0.746, CI [-0.063, 0.032]); unsure rate 0.29 -> 0.24; fill \$1.59
2026-10-03 16:58:37 +02:00
fixtures
feat(ruleset): PHP quick-mode rules from the engine's vocabulary, measured on the development corpus
2026-09-30 15:05:47 +02:00
independent
ci: green again -- format and lint the whole tree; push the scan and runner images to GHCR on tags
2026-10-02 20:09:28 +02:00
learn
unseen-eval: calibrated replay deadline + native agreement check, docker-lane diagnostics, proof 4.4 record; engine runner cleans up fetched sources
2026-10-05 08:14:57 +02:00
manifests
feat(ruleset): PHP quick-mode rules from the engine's vocabulary, measured on the development corpus
2026-09-30 15:05:47 +02:00
measurements
search-with-proof: executor smoke driver and pilot selection (6.1)
2026-10-05 17:26:06 +02:00
pairs
learn: 251 more advisory-fix pairs whose function survives the fix (advisory-fixes-3)
2026-10-04 11:57:34 +02:00
push
perf(taint): ask the caller check only of a parameter that starts a flow into the field
2026-09-23 22:49:44 +02:00
ranking
feat(pre-push-safety-net): preserve uncertainty in benchmark scoring
2026-09-12 19:04:20 +02:00
repos
feat(pre-push-safety-net): pin labeled evaluation inputs
2026-09-12 18:45:54 +02:00
search
search-with-proof: bootstrap intent, real reason/explore contracts, visible refusals
2026-10-05 19:18:12 +02:00
unseen
unseen-eval: calibrated replay deadline + native agreement check, docker-lane diagnostics, proof 4.4 record; engine runner cleans up fetched sources
2026-10-05 08:14:57 +02:00