Registry / experiments
Experiments
- E30-B
Proposed matched-compute shadow trial of the RISE Gate
No E30-B results are reported. Blocked until critical readiness controls pass in a sandbox and the receipt verifier is tested independently. Proposed 720 paired cases, four arms, matched compute and independent exposure records.
From Round 30 · tests H30.2, H30.3, H30.4, H30.5
Proposed - E29-A
Exact finite deterministic interventional-lineage diagnostic
72 structural worlds, 36 paired response behaviors, six policies and four budgets yield 1,728 traces. Full content probes identify behavior in 100% and provenance in 0%. Exact only for the declared diagnostic. No live benchmark ran.
From Round 29
Executed (diagnostic) - E29-B
Proposed matched-cost live Interventional Lineage Test
No results reported. Preregistration-ready design for 720 paired cases; permissioned replay, independent receipts and fixed compute required.
From Round 29 · tests H29.1, H29.2, H29.3, H29.4, H29.5, H29.6
Proposed - E28-A
Exact fixed-compute constructed trace replay
Model-set intervals were conditionally valid in-model, but passive adequacy signals failed on the hidden-common-origin alias. TSAR did not universally dominate a scalar. E28-A is an exact constructed trace replay of 9,744 frozen histories and 29,232 weighted rows, not a production, language-model, or Encevra answer benchmark. Round 29 remains a proposed study of active dependency interventions that can reveal omitted dependencies.
From Round 28 · tests H28.1, H28.2, H28.3
Executed (diagnostic) - E27-A
Exact finite constructed diagnostic of budgeted verification policies
E27-A is exact only for the declared scenario set, deterministic observation rules, authored cost tables, priors, and policies: 58 worlds per dependency variant, a 116-scenario planning set, 9,744 policy-world runs, and 504 aggregate evaluation cells. Four model-set gate policies produced no wrong categorical verdict in 3,712 in-model runs; the out-of-model hidden_common_origin stress produced false-clean rates up to 33.68 percent at budget 9. Not a production trial, not a language-model reasoning benchmark, and no live Encevra benchmark was run. E27-B and H27.1 to H27.7 are proposed. Architecture impact: None. Production impact: None.
From Round 27
Executed (diagnostic) - E27-B
Fixed-compute shadow comparison of model-set adaptive verification
Not run. Requires fixed-compute shadow trial with hidden independent adjudication, frozen lineage graphs, costs, and policies, and separate natural and sandbox strata.
From Round 27 · tests H27.1, H27.2, H27.3, H27.4, H27.5, H27.6, H27.7
Proposed - E26-A
Deterministic finite-model identifiability analysis
E26-A is exact only for its declared finite model: 2, 16, 58, and 128 worlds at fault budgets 0 through 3, respectively. Seven failure roots and eight observable types were enumerated, with eight executable tests passed. Root independence is an assumption. The proposed Observation Sufficiency Certificate (OSC) is research-only, not installed or production-validated. No production incident was sampled, no language model was benchmarked, and no new Encevra answer benchmark was run. E26-B and H26.1 to H26.7 are proposed. Architecture impact: None. Production impact: None. The automation brief named Round 11, but the inspected archive ended at Round 25, making Round 26 sequential.
From Round 26
Executed (diagnostic) - E26-B
Prospective fixed-budget observation-sufficiency shadow experiment
Not run. Hidden independent adjudication, fixed budgets, and separate natural and sandbox strata required.
From Round 26 · tests H26.1, H26.2, H26.3, H26.4, H26.5, H26.6, H26.7
Proposed - D25-A
Adversarial-omission authored conformance diagnostic (D25-A)
D25-A is an authored-fixture conformance diagnostic, not production evidence. 80 traces: 60 positive gaps, 20 negative controls. SACP TP=55/60, FP=0/20, trace recall 0.9167, claim-weighted recall 0.8944, with five intentional misses.
From Round 25
Executed (bounded diagnostic) - E25-B
Prospective fixed-budget multi-authority silence-coverage trial with hidden independent adjudication
Not run.
From Round 25 · tests H25-1, H25-2, H25-3, H25-4, H25-5, H25-6, H25-7, H25-8, H25-9, H25-10
Proposed - D24-A
Authority coverage audit and authored conformance diagnostic (D24-A)
D24-A is a deterministic authored-fixture conformance diagnostic, not an estimate of production precision, recall, reliability, prevalence, or cost. No Encevra answer benchmark, provider experiment, production observer, or deployment was run.
From Round 24
Executed (bounded diagnostic) - E24-B
Prospective multi-authority authority-lineage revalidation experiment with independent adjudication
Not run.
From Round 24 · tests H24-1, H24-2, H24-3, H24-4, H24-5, H24-6, H24-7, H24-8
Proposed - D23-A
Prospective shadow trial of claim revalidation (D23-A)
Result boundary: one post-freeze real commit interval; same-process post-hoc impact labels; eight authored conformance fixtures; zero model, provider, production-database, and production-write calls; no product reliability, answer-quality, security, latency, or cost claim; no production CTAG or ABMG implementation.
From Round 23
Executed (bounded shadow diagnostic) - E23-B
Prospective multi-commit CTAG shadow evaluation with independent adjudication
Not run.
From Round 23 · tests H23-1, H23-2, H23-3, H23-4, H23-5, H23-6, H23-7, H23-8
Proposed - D22-A
Deterministic code-change routing diagnostic (D22-A)
Seven internal consistency checks passed. D22-A is deterministic routing against a manually audited actual diff plus authored mutation fixtures. It made zero model/provider/production-database calls. It is not a model-quality benchmark, automatic dependency-discovery result, production integration test, security audit, product reliability claim, production change, or deployment.
From Round 22
Executed (diagnostic) - E22-B
Prospective CTAG evaluation on unseen Encevra changes at controlled verification compute
Not run. Preregistered selectors, independent two-reviewer gold set, prospective real commits plus controlled mutations.
From Round 22 · tests H22-1, H22-2, H22-3, H22-4, H22-5, H22-6
Proposed - E21-A
Deterministic attempt-bound measurement gate diagnostic (D21-A)
34 of 34 named checks over constructed write states, envelope mutations, source-version pairs, provider-response pairs and stream fixtures. Zero model, provider network, or production-database calls. Conformance diagnostic, not an outcome benchmark.
From Round 21
Executed (diagnostic) - E21-B
Shadow ABMG evaluation on real provider traffic at fixed model compute
Not run. Shadow mode at the provider adapters with fault injection, an independent proxy oracle, ablations, and preregistered adoption thresholds.
From Round 21 · tests H21-1, H21-2, H21-3, H21-4, H21-5, H21-6
Proposed - E20-A
Deterministic minimal-disclosure receipt development harness
76 of 76 named checks across 96 constructed episodes, eight synthetic task families, twelve corruption families, and 6,912 mutated episode-arm evaluations; 480 valid reveals verified, 480 altered reveals rejected. Zero model calls; development diagnostic, not a security evaluation.
From Round 20
Executed (diagnostic) - E20-B
Held-out receipt comparison against strong generic traces
Not run. Compares MDIR against strong generic traces with independent immutable export on frozen synthetic trajectories, including unavailable openings and failed checkpoints.
From Round 20 · tests H20-1, H20-2, H20-3, H20-4
Proposed - E19-A
Deterministic evidence-lifecycle validator and static collector audit
44 named checks across 15 constructed fixtures; static audit of 18 collector requirements (4 present, 3 partial, 11 absent). No model call or human annotation.
From Round 19
Executed (diagnostic) - E19-B
Reconstruction under frozen trajectories
Not run. Tests the measurement contract, not model intelligence; specified to run before E18-B.
From Round 19 · tests H19-1, H19-2, H19-3
Proposed - E18-A
Exact deterministic constructed bitemporal and repair diagnostic
36 passing checks (24 across all six arrival orders, 12 semantic) and twelve developer fixtures. No language-model benchmark, model call, or human annotation.
From Round 18
Executed (diagnostic) - E18-B
Five-arm versioned evidence study (O0/A0/T0/B0/B1)
Not run; gated on the existing Round 13 collection gate. Proposed 480 development episodes across twelve source families.
From Round 18 · tests H18-1, H18-2, H18-3
Proposed - E17-A
Exact finite constructed recoverability diagnostics
28 named checks, all 15 partitions of a four-world example, 60 deterministic recompressions, and twelve developer fixtures. No language-model benchmark or model inference.
From Round 17
Executed (diagnostic) - E17-B
Frozen-handoff question-change study (P0/P1/S0/S1)
Not run or preregistered; gated on the existing Round 13 collection gate. Proposed 288 core episodes across twelve source families.
From Round 17 · tests H17-1, H17-2, H17-3
Proposed - E16-A
Exact finite-world sufficiency diagnostics
6,912 Boolean function-observation pairs, 37 named checks, and twelve generated developer fixtures. No language-model benchmark or model inference.
From Round 16
Executed (diagnostic) - E16-B
Bounded missing-condition study
Untested with language models; not preregistered or run. Proposed 24 instances and 192 assigned continuations across B0-B3, after the Round 13 collection gate.
From Round 16 · tests H16-1, H16-2, H16-3
Proposed - E15-A
Exact diagnostics on constructed distributions
32 mathematical checks on invented distributions. No model inference or human annotation.
From Round 15
Executed (diagnostic) - E15-B
Study A: support and recommendation fields (2x2)
Not preregistered or run; follows the Round 13 collection gate.
From Round 15
Proposed - E15-C
Study B: complementary withheld facts (optional)
Not preregistered or run; oracle delivery cannot establish sender discovery.
From Round 15
Proposed - E14-A
Exact offline label-uncertainty diagnostics
30 checks on invented labels, reproducible from published files. No model inference or human annotation.
From Round 14
Executed (diagnostic) - E14-B
Masked-replay comparison of evaluation methods
Proposed for preregistration, not registered or run; same frozen answers and matched annotation and judge budgets.
From Round 14 · tests H14-1, H14-2, H14-3
Proposed - E13-A
Audit of saved Noetis evaluation records
Offline replay and perturbation of existing exports. No new model runs.
From Round 13
Executed (audit) - E13-B
Local revision pilot with evidence receipts
Fixed-state branches; labels not produced by the system under test.
From Round 13 · tests H13-1
Proposed - E12-A
Exact synthetic calibration diagnostics
Worked calculations on invented episodes, reproducible from published files.
From Round 12
Executed (diagnostic) - E12-B
Terminal release calibration study
Preregistered; identical generation compute across arms.
From Round 12 · tests H12-1, H12-2, H12-3, H12-4
Proposed - E11-A
Marginal-value verification controller
Three cost ceilings; harmful-revision denominator fixed in advance.
From Round 11 · tests H11-1, H11-2, H11-3, H11-4
Proposed - E10-A
Evidence exchange versus conclusion sharing
Six arms including debate and independent baselines.
From Round 10 · tests H10
Proposed
Research to architecture
Changes made to Noetis because of a research round. These are safeguards and contracts; none is claimed to improve answer quality until tested.
- A-03
Revision-drift guard
Flag synthesis that omits supported risks or adds untraced claims, rather than presenting it as consensus.
Source: Round 12, 13
In Noetis (preview) - A-02
Uncalibrated release-risk contract
Return a null risk score until version-bound, externally labelled calibration exists.
Source: Round 12
In Noetis (preview) - A-01
Conservative role triage with full-panel fallback
Skip optional roles only on confident, valid routing; otherwise run every role.
Source: Round 11
In Noetis (preview)