Open_Ultra_SAST/benchmarks/measurements/2026-10-13-access-control-screen/separation.csv at fbbc03f3ea6ed4609a6b1fb2bb6ca1b540bfba55

mirror of https://github.com/norandom/OpenUltraSAST.git synced 2026-10-16 03:49:26 +00:00

Files

T

Marius CiepluchandClaude Fable 5.1 fbbc03f3ea measure: access-control feature table and separation screen (952 rows, 74 positive rows, 5 repositories); first ablation manifest registered

Three builds: the first two read 150 rows as empty (a producer bug, fcb43fd), the third is clean. The diff
producer was blind to removed lines (537b61e). Screen: deletion_count 0.89 is the reversed-fix construction;
on rows whose file lost lines entry_point_count 0.83 and caller_count 0.73 are the class signal; semantic covers
262 rows (TypeScript only). Repository folds assigned, leak audit recorded, manifest ac-ablation-1 registered
for decision (five arms, about 35 dollars).

Co-Authored-By: Claude Fable 5.1 <[email protected]>

2026-10-14 02:45:35 +02:00

909 B

Raw Blame History

1	column	auc	n	annotation
2	diff.distance	0.7519618922057947	935	hunks
3	diff.on_changed_line	0.26616080773256173	952	hunks
4	diff.hunk_count	0.26391368589546266	952	hunks
5	diff.hunk_lines	0.1529581973773318	952	hunks
6	diff.deletion_count	0.8854275687988672	952	hunks
7	source.span_lines	0.36404681748104334	933	function_text
8	source.is_module	0.3577462794575717	933	change_summary
9	source.caller_count	0.7206525501054023	933	callers
10	source.caller_files	0.7166567032690432	933	callers
11	source.entry_point_count	0.7070918415505144	933	entry_points
12	semantic.sources	0.6976744186046512	46	roles
13	semantic.sinks	0.17441860465116277	46	roles
14	semantic.sanitizers	0.4534883720930233	46	roles
15	semantic.binds	0.35999015748031493	262	def_use
16	semantic.calls	0.5642224409448819	262	def_use
17	semantic.obligations	0.7541830708661417	262	obligations
18	semantic.obligations_undischarged	0.7620570866141732	262	obligations

909 B Raw Blame History

909 B

Raw Blame History