Skip to main content

The Evidence Ladder

miStudio can discover candidate circuits, but discovery is not proof. A cross-layer edge can be a strong statistical association and still not be a mechanism the model actually uses. So every circuit and every edge carries an evidence rung — a single, honest grade of how strong the evidence for it is — and the interface uses server-rendered language for each rung so nothing ever gets described more confidently than the evidence allows.

The four rungs​

RungNameWhat earned it
0minedSurfaced by statistical mining (PMI, support, null model, held-out replication). An association, disclosed as such.
1attribution-supportedA gradient-attribution pass agrees in sign and magnitude. A second independent signal — still not causal.
2causally validatedIntervention (suppress the upstream, measure the downstream) shows a real effect beyond a matched null (Feature 017).
3faithfulness-testedThe circuit's members are shown necessary and sufficient for the behavior, not just individually implicated (Feature 017).

A circuit's rung is the minimum over its edges — a circuit is only as validated as its weakest link, and a circuit with no edges sits at rung 0.

Rules that keep it honest​

  • The word "causal" never appears below rung 2. Mined and attribution-supported edges are described as candidates and associations. Only intervention earns causal language, and the language comes from the server, not the client.
  • A failed test never demotes. If an edge is tested and the effect doesn't hold, that tested_and_failed fact is recorded as history — it doesn't erase a rung the edge earned another way, and it's visible so you know what was tried.
  • Promotion is a badge, not a gate. You can promote an unvalidated circuit into a steering profile — it just carries its rung visibly everywhere, so a rung-0 circuit is never mistaken for a proven one.

The ladder is why you can trust the Circuits panel: it tells you exactly how much is known, and it is structurally prevented from telling you more.