AGI v1.10 — the White-Box Verified-Honesty frontier design
One line. The frontier we can actually own is not a bigger model — it is a model whose honesty is verified inside the box (in the activations), trained on data we minted against reality instead of scraped. Capability is rented and commodity; the verifier and the verified corpus are the moat. This is the honesty-axis twin of the coding-axis Spiral: same thesis — the verifier, not scale, is the source of generalization — applied to truthfulness instead of code.
Status: Proposed. This is a design + freedom-to-operate note, grounded in fresh (2026) external literature and patents. It does not authorize a training run; ADR-0024's kill-gated program and the operator ADR-approval gate still apply. It answers the founder's standing objection ("everything committed is copy-paste; prove a training program would work before I approve it") by (a) naming the one component renters structurally cannot have, and (b) making the proof a cheap dose-response gate.
1. Why honesty is the only frontier axis worth owning
Capability is a commodity: every frontier model is a transformer + MoE trained on the same scraped web, and open Qwen-scale coders already sit near Claude 3.5 on SWE-bench (see Spiral §2). We cannot out-parameter the frontier and gain nothing by trying.
The unsolved, unowned axis is honest calibration — knowing and saying what you don't know. Two independent literatures converge on it as a first-class training objective, not a post-hoc patch:
- Abstention-aware objectives. Reinforced Hesitation (2511.11500)
replaces binary RLVR rewards with a ternary reward +1 correct /; varying λ traces a Pareto frontier of risk regimes. I-CALM (2604.03904) and TIAR (2605.25850) incentivize confidence-aware abstention. Surveys (2407.18418) note the effect of refusal-aware data in pretraining is essentially unstudied — an unoccupied slot.+1 correct /abstain / −λ error+1 correct /abstain / −λ error+1 correct /abstain / −λ error+1 correct /abstain / −λ error+1 correct / 0 abstain / −λ errorabstain / −λ error
- Honesty as a measurable property. The E1 result on our own stack (confab 10%→55% once the
status-gloss was stripped) proved that output-level honesty tunes learn a surface shortcut. The fix is to check honesty where the shortcut can't reach: inside the network.
2. The differentiator — verify honesty in the activations (white-box)
A rented API model is a black box: you see tokens, nothing else. Output-graded honesty is exactly what E1 gamed. Open weights expose the hidden states, and theliterature shows a truth signal lives there and is cheaply readable:
| Finding | Source | Number |
|---|---|---|
| Mid-layer linear probe decodes truthfulness; MLP probes add <0.01 AUROC | 2606.02628 | 0.904–1.000 AUROC held-out (TruthfulQA/HaluEval/FEVER) |
| …on 4-bit NF4 quantized 7–8B models, consistent probing-layer band across Llama/Mistral/Qwen | 2606.02628 | probes blocks 13–18/32, 19–25/28 |
| Sampling/consistency detectors, same protocol | 2606.02628 | ≤0.541 AUROC (near chance) |
| Preemptive detection before the token is emitted; trajectory probing without per-language FT | 2410.02899 · 2605.24919 · 2507.16488 | — |
The load-bearing caveat (designed around, not ignored). 2510.09033 shows internal states mainly encode knowledge recall, not truthfulness: they cleanly flag unassociated confabulation (no parametric grounding) but not associated errors (learned spurious correlations look identical to fact internally). Our own toy confirms the failure mode direction: probe_seeinthebox.py on Qwen2.5-0.5B scored de-glossed AUROC 0.53–0.65 vs glossed 1.000 — at 0.5B the arithmetic-truth representation isn't linearly present, so the probe would read the gloss, not honesty.
Design consequence → a dual verifier. The probe is a partial honesty oracle. Pair it with the output-side verifier the Spiral already owns (execution / proof / citation). Each covers the other's blind spot: the probe catches confident-but-ungrounded (unassociated) confabulation the output check can't see pre-emptively; the exec/citation check catches associated errors the probe can't distinguish. Honesty is accepted only when both pass.
3. Architecture pillars (each rented + grounded, per the blueprint)
| Pillar | Choice | Fresh grounding | Owned or rented |
|---|---|---|---|
| Reasoning base | Ouro LoopLM recurrent-depth (weight-tied, Q-exit) | 2510.25741 | rented (open weights) |
| Loop stability | STARS Jacobian-spectral-radius reg. (depth-collapse fix) | 2605.26733 | rented method |
| Loop caveat | readout blind spot under dense supervision — governs where we read the probe | 2606.24898 | caveat |
| Serving artifact | ternary W1.58A8 via BitDistill 3-stage QAT | 2510.13998 · 2502.11895 | rented method (ADR-0026) |
| Objective | honesty-native: ternary abstention reward + SFT→DPO | 2511.11500 · 2604.03904 | owned framing |
| Honesty verifier | mid-layer probe as held-out, rotating, off-gradient audit | 2606.02628 + caveat 2510.09033 | OWNED (the moat) |
| Training signal | verified-experience only; RLVR incentivizes correct reasoning, generalizes | 2506.14245 · 2512.20760 | owned corpus |
| Data | convergence records + PR/session mining + arXiv/patent grounding | v1.10 issues #2841–#2848 | OWNED |
Ternary-survival is an honest open gap. 2606.02628 confirms the probe survives 4-bit; it does not confirm 1.58-bit ternary. Re-validating the probe on the ternary serving artifact is a named acceptance test, not an assumption.
4. Freedom to operate — read as an inventor
Fresh patent inspection (2026):
- US 12,468,899 B2 (Adobe, priority 2023-05-08) — a "hallucination gatekeeper" that checks facts
by string-match + edit-distance on the OUTPUT text, regenerating on miss. Explicitly not hidden-state / white-box. Claim language: "…checks the natural language insight to ensure that each fact… is located in the natural language insight."
- CNB — three-level
confident / uncertain / uncorrelatedscoring with corrective
retrieval flow. Also output-level only.
Inventor read. The public patents cover output-level fact-grounding; white-box truthfulness probing is unclaimed by them. The probe technique itself is academic prior art (2606.02628 et al.), so it is not novel in isolation. Any defensible novelty is the system combination — a rotating, off-gradient internal-honesty probe used as a held-out verifier gating a distillation loop trained on self-minted, dual-verified convergence data — which mirrors the Spiral's stance that the moat is the system, not the model. (Worldwide FTO needs the EPO OPS key noted in the patent-sources memo; this is a first pass, not a legal opinion.)
5. The two traps this design must not repeat
- Goodhart on the probe. The instant the probe becomes a training loss, the student learns to
fool it (the trained-gamer risk in docs/SIGMA0-MODEL-DESIGN.md §7.2). The probe stays off the gradient path — a held-out audit, ideally re-trained fresh after each student version so the student can't pre-empt a detector that didn't exist when it trained.
- Convergence ≠ truth. A council can converge, confidently, on garbage. Only records whose
converged answer passed a real verifier (execution / proof / citation) become training targets — never agreement alone. Gekhman ([2405.05904], cited in the Spiral) shows SFT on unverified data raises hallucination.
6. The phase map (operator-approved 2026-07-22; replaces the old proof-gate list)
Rulings recorded (see survey §5 and the ADR-0024 amendment): G1 compromise approved — exec-verification is the non-negotiable gate on every training target; on-policy logit distillation is permitted as the transport for the student/serving tier only. ADR-0024 Phase-3 (from-scratch frontier) retired to research-option. The program is now a post-training program on open weights, shaped like thestandard stack (survey §1/§1b), with our dual verifier bolted on where the labs put their reward oracle.
Phase V0 — Foundations (no training; the hard preconditions)
Everything here is cheap, parallel, and blocks everything below.
- Eval power (survey G5): build the honesty eval to ≥140 held-out de-glossed negatives
(±5pp resolution; ~203 for ±3pp per SIGMA0-MODEL-DESIGN), pre-registered protocol, 13-gram decontamination extended to honesty sets. Add the gates-off arm (G11) to the harness.
survey G3/G4): mine allsessions + full PR history (incl. reverts) into both-class records; de-gloss lint; MinHash dedup + perplexity filter; anchor mix ≥60% general data in every future train; LOSO splits.
- Probe re-validation (issue #2845):
scale ladder 1.4B → 7B, de-glossed, including an associated-hallucination set per 2510.09033.
- Kill-gate V0: if the de-glossed probe never clears AUROC ≥ 0.75 at any affordable open
scale, the white-box audit is demoted from verifier to telemetry and §2 is redesigned.
RESULT (2026-07-22, MEASURED — GATE PASSED). probe_ladder.py over the frozen de-glossed set (data/eval/v1_10/probe-sets-v1.jsonl,rows), 5-fold CV AUROC, best over layer×{mean,last}:
| family | 0.5B | 1.5B | 7B (4-bit NF4) | |
|---|---|---|---|---|
| factual (recall-truth) | 0.837 | 0.980 | 1.000 | |
| assoc (associated misconception — [2510.09033] hard case) | 0.703 | 0.774 | 0.924 | |
| arith (control) | 0.747 | 0.869 | 0.901 |
Findings: (1) reproduces [2606.02628] on our hardware — factual truth linearly decodable at 1.000 on a 4-bit 7B, peak in the mid-to-late band (L17–23), last-token pooling ≥ mean. (2) The associated-hallucination pessimism is scale-dependent, not fundamental: the split [2510.09033] said was internally invisible climbs 0.70→0.77→0.92 — at 7B the probe reads associated-claim truth strongly. The white-box audit is a viable verifier at the 7B teacher scale. (3) Dual verifier still stands: at ≤1.5B assoc is weak, so the output-side check remains load-bearing for the small serving tier. Open acceptance test unchanged: confirmed at 4-bit, not yet at 1.58-bit ternary (V3).
Phase V1 — Honest teacher (first spend; open weights, 7B-class)
- De-glossed SFT (anchored mix) → DPO on honesty preferences (assert/abstain pairs from the
both-class corpus). muP-style lr transfer (G6) — no hand-tuned lr.
- Kill-gate V1: beats base on confabulation at equal golden accuracy on the powered eval, CI
excluding zero, gates-off arm reported. Fail → stop; the thesis is refuted cheaply.
Phase V2 — Verifier-rewarded RL (the owned stage; the dose-response proof)
- GRPO/RLVR where the reward oracle is the dual verifier: exec/citation output check +
abstention-aware ternary reward (+1 correct /2511.11500abstain / −λ error, 2511.11500). The probe stays off-gradient — audit only, re-trained per candidate (anti-Goodhart).
- Run the Arm A (imitation) vs Arm B (verified) dose-response here
(issue #2847).
- Kill-gate V2: Arm B beats Arm A with a lead that grows with verified-data dose. Flat or
shrinking → the verified-data moat thesis is dead; say so and stop.
Phase V3 — Consolidate & distill to the serving tier (G1 compromise applied)
- On-policy distillation (the approved transport; DeepSeek-V4/Qwen3 shape) from the V2 teacher
into the student (1.4B–4B class), anchored mix, every training target still exec/citation-gated.
- Student passes the probe audit (internal honesty) and converts to the ternary artifact
(ADR-0026); named acceptance test: the probe must survive ternary quantization (2606.02628 only proves 4-bit).
- Ships with a model card (G7): powered-eval results, gates-off results, known regressions
stated plainly.
Phase V4 — research option, unfunded (the retired from-scratch tier)
- Reopened only on evidence from V1–V3 that a pretraining-level intervention is necessary (e.g.
the honesty property provably cannot be instilled post-hoc), per the ADR-0024 amendment.
Sequencing: V0 now; V1 after V0's gates; V2 after V1; V3 after V2's curve is positive. Each phase emits ConvergenceRecords either way — honest nulls included.
Toy harness: experiments/v1_10_toy/ (PR #2849). Full design tracked as epic #2841.
6a. Design principle — deterministic from the outside (operator directive, 2026-07-22)
Variance is for the inside; determinism is for the outside. Σ₀ behaves like a bandit that has converged: exploration (sampling, best-of-N, tier/route search) happens inside the loop and is consumed by the verifier; the user always sees the greedy arm. The invariant (M1 in product form):
The answer is a function of (question, verified knowledge) — never of the sampling path. An answer may change only when evidence changes (or on a logged version bump), and the change carries its receipt. Re-asking is not re-rolling.
Mechanisms (each maps to an existing component): serve converged answers from the ledger, not the dice (the convergence-record serving path — the one missing piece); greedy decoding as the assistant default; sample-inside/select-by-verifier (spiral + probe-gate argmax); bandit-converged routing pinned until a regret signal (generalize convergence-router); an answer-stability canary (re-ask K canonical questions daily; instability without an evidence-delta = drift alarm — a new M3 axis). Scope honesty: product-level determinism (same visible answer), not bitwise GPU determinism. A deterministically-wrong answer is a feature: it is a mineable, fixable record — RNG-wrong is unfixable fog.
6c. The Reason-stage counterpart — answers as fixed points, not samples (pinned 2026-07-22)
§6a demands determinism from the outside; this section names the model class that delivers it natively. Today's LLMs are samplers because they are trained as distribution estimators — the randomness is the output interface, not the intelligence (the theoretical ideal agent, AIXI, is an argmax, not a sampler). Four real non-sampler classes exist: energy/optimization models (JEPA lineage — inference = descend to a minimum), equilibrium/attractor models (DEQ; Hopfield ancestry; Fixed-Point Reasoners 2606.18206 — the fixed point h*=f(h*) is the answer; Equilibrium Reasoners 2605.21488), neurosymbolic provers (answer = artifact that checkably satisfies a spec), and deterministic-ODE flows. None is scaled alone; the scaled shape is stochastic proposer inside a deterministic objective.
The load-bearing distinction: temperature-0 gives point determinism (identical string → identical answer, but a paraphrase takes a different trajectory — deterministic yet chaotic). Attractor dynamics give basin determinism: every phrasing of the same question falls into the same basin → same answer. §6a's user contract requires basin determinism.
Σ₀ already implements this at the system level — named here so it's designed on purpose:
- The Ouro kernel is the attractor substrate.
src/sigma0/loop_lm.pyruns weight-tied
recurrence with fixed-point exits — OURO_MODE=converge (first-order ‖hₜ−hₜ₋₁‖<ε) and accel (second-order, spiral-robust) are literally equilibrium halting (SIGMA0-OURO-CODER §7); STARS (2605.26733, full-text verified) is the training-side stabilizer (ρ(J)<1) that makes deep recurrence converge instead of collapse. ADR-0021's retained custom loop is what makes this ownable.
- The verifier is the energy function. Exec tests + the probe define the minimum; the spiral is
optimization-based inference (propose → verify → converge), with sampling demoted to interior search consumed by the verifier's argmax.
- The ledger is crystallized attractors — a converged verified answer becomes a basin future
queries fall into (the serve-from-ledger path, #2859, with question-canonicalization as the basin boundary).
Research bet (Reason-stage, canary-gated): push basin determinism from the system level into the kernel — train the looped model so paraphrase-perturbations contract into the same fixed point (STARS-style JSRR + paraphrase-consistency objective), measured by the #2859 answer-stability canary. This is the Reason-stage twin of the white-box honesty thesis: honesty verified in the activations; answers defined by attractors, not dice.
6b. Citation grounding (full-text verified)
All external claims in this doc were verified against full source text on 2026-07-22 — see the grounding ledger + patent landscape (33/40 citations held exactly,overstatements corrected,assocfabricated). The two load-bearing ones held: 2606.02628 (probe 0.904–1.000 on 4-bit 7–8B) and 2510.09033 (associated-hallucination detection near-random) — with the scope note that their "AH" (Wikidata associations) differs from our probe-ladder assoc set (misconceptions), so the two are complementary, not contradictory.
7. Related
- SIGMA0-OURO-CODER.md — the coding-axis twin (the Spiral; verifier-gated
cascade + VTD). This doc is its honesty-axis counterpart; both share the "verifier > scale" moat.
- ADR-0024 (frontier training program) ·
ADR-0026 (ternary serving) · ADR-0021 (Ouro loop).
- docs/SIGMA0-MODEL-DESIGN.md (the honesty corpus / E1 de-gloss) ·
docs/AGI-CONVERGENCE-BLUEPRINT.md (rent-capability / own-grounding).
- Epic #2841 + children #2842–#2848.