docs/AGI-CONVERGENCE-BLUEPRINT.md
By Alex Place · Updated 2026-07-21

The Convergence Blueprint — one loop, everything we know

The whole system, AGI-scope, as one document organized by the North-Star loop: Observe · Remember · Reason · Act · Verify · Converge. Each stage lists the conventional best practice (cited, 2026), what we have in-repo, and the honest gap. This is the synthesis of what we know: the Collapse Certificate is the Verify discipline; the frontier-model literature supplies the rest.

Companion docs, not replacements. North Star: CONVERGANCE-SIGMA0-BRIEFING.md. Living references: RESEARCH-CANON.md. Code alignment: convergence-core-mapping.md. Verify economics: SIGMA0-GROUNDING-LEDGER.md. This document is the map over all six stages; those go deep on one each.


The thesis (grounded, and it sets expectations)

Building the best AI model possible inis "not algorithmic creativity, it is efficiency optimization"; data quality matters more than algorithm choice; and architecture is treated as a commodity — every frontier model is a Transformer, and MoE is behind virtually all of them (LLM Anatomy 2026; Toloka; MoE comparison).

Two consequences for an AGI-scope program:

  1. The differentiator is execution across the whole loop, not one clever mechanism. No stage

below is won by novelty; it is won by data + systems + disciplined iteration.

  1. Our genuine edge is the Verify stage. Theagentic frontier's named failure modes —

"error accumulation, goal drift, context degradation over long trajectories" and "memory staleness → confidently wrong" (agent-memory 2026; long-horizon reliability) — are exactly the collapse-without-grounding phenomena the Collapse Certificate formalizes. So our Verify discipline is not a corner of the loop; it is the discipline the whole loop is currently missing at the frontier.

Evidence classes used below: ESTABLISHED (conventional, external, cited) · IN-REPO (we have it, with pointer) · GAP (needed, not ours, sourced) · OURS (a genuine in-repo contribution — rare, and only the Verify discipline qualifies). No arXiv ID is cited unverified (see the Certificate's fabricated-ID caution).


OBSERVE — contact with external reality

The loop's only tie to ground truth. Everything downstream degrades without it (that is the Certificate's central result).

  • Best practice (ESTABLISHED). Two channels. **(a) Training-time observation = pretraining

data: curation, dedup, quality filtering, and LLM-rephrasing of low-quality web text (standard since late 2024), with a human-data anchor ≥60–70% and synthetic data as targeted amplification on verifiable domains. The binding constraint at the frontier is data, not FLOPs — high-quality public web text is forecast exhausted 2026–2028 (Toloka; Epoch AI). (b) Inference-time observation = retrieval + tools + multimodal input**: multi-signal retrieval (semantic + keyword

  • entity + graph, run in parallel) beats sequential

(agent-memory 2026).

  • In-repo (IN-REPO). lib/tool-runner.js native tools (web_search, market data, doc

extract, recall_memory); the arXiv corpus + BM25 retrieval; the RAG reranker (local cross-encoder, +21pt MRR on low-overlap — [[rag-reranker-is-the-win-not-m2v]]).

  • GAP. We have no pretraining-data pipeline — no FineWeb-style curation, no rephrasing,

no mixture-law tuning. This is the single largest gap and the frontier's #1 bottleneck. Sourced: QuaDMix quality-diversity selection; mixture prediction via scaling laws.

REMEMBER — knowledge, in weights and outside them

Two memories, deliberately: parametric (learned) and persistent (append-only + archive). The Certificate's rule — one JSONL append + one CSF archive — is the anti-sprawl guard here.

  • Best practice (ESTABLISHED). Parametric: 10–20T-token pretraining puts knowledge in

weights; MoE raises knowledge capacity at fixed active-FLOPs. Non-parametric:treats memory as a dedicated architectural component, not a longer prompt — vector retrieval for fuzzy knowledge + key-value for structured state + episodic logs for audit; tiered "OS-memory-hierarchy" management (Letta-style: context = RAM, store = disk). Named failure: staleness → confidently wrong (agent-memory 2026; context→dreams).

  • In-repo (IN-REPO). CSF archive (one lossless zstd/zlib-backed store) + append-only JSONL

memory; MemOS per-keeper cubes; conversation-per-user profiles. Working "knowledge RENTED, not owned" hybrid-architecture stance ([[hybrid-architecture-redteam-verified]]).

  • OURS (Verify-adjacent). The staleness failure mode is the Certificate's drift: a

highly-retrieved memory that is "confidently wrong after the user changes jobs" is a grounding failure, and the §4 surprise/NIS canary + the Grounding Ledger's freshness law are the exact discipline for it. [claim: our memory-verify discipline addresses the frontier's named staleness failure · confidence: Medium — argued, not yet measured on an agent · source: agent-memory+ cert §4/§8.4.1]

  • GAP. No trained MoE knowledge base of our own; parametric memory is rented from base models.

REASON — the core model + inference-time compute

Where the loop actually thinks. Architecture is commodity; the live frontier is test-time compute — and it is exactly the looped/latent-reasoning family the project already bet on.

  • Best practice (ESTABLISHED). Architecture: Transformer + MoE (commodity, but the

scaling substrate). Reasoning: explicit long-CoT + search (majority vote, ToT, MCTS) and latent/looped reasoning — recurrence + parameter sharing scale depth at test time; a 3.5B recurrent-depth model reaches ~50B single-pass effective compute by adding loops (latent-reasoning survey arXiv:2507.06203; Ouro/LoopLM arXiv:2510.25741; LoopFormer). Budget-conditioned depth is the efficiency lever.

  • In-repo (IN-REPO). Ouro-1.4B LoopLM is the serving substrate (weight-tied recurrent

transformer, dynamic depth) — the project is already on the winning test-time-compute architecture ([[ouro-looplm-research]]; ADR-0021). Nested adaptive Reason (Q-exit + escalation).

  • OURS (Verify-adjacent). The looped-LM's known pathology — **"performance peaks at a depth

then collapses"** — is the Certificate's §1 result on real models, and the §1.2.3 acceptance gate (ρ(J)<1, adopted from STARS arXiv:2605.26733) is the stability discipline for it. This is the one place our Verify work and the frontier Reason architecture are the same object.

  • GAP. We do not train the reasoner (Ouro is rented); reasoning-RL (below, Converge) is

gate-only, not a training loop we run.

ACT — tools, code, actuation, agency

Turning a thought into an external effect — and the point where verification must re-enter, because actions compound error.

  • Best practice (ESTABLISHED). Modular agent architecture: tool-calling, code execution,

planner/executor separation, and verification-in-the-loop because long-horizon reliability collapses — agents are far less reliable over 100-step than 10-step trajectories; error accumulation and goal drift worsen with length (architecture of agency 2026).

  • In-repo (IN-REPO). Native tool-calling loop (CHAT_TOOL_EXEC=1, lib/tool-runner);

autowork self-coding (worktree-isolated, surfaces in chat); shell-free command exec (lib/safe-exec.js); the council exec-verify (real Python run).

  • OURS (Verify). "Actions compound error over long trajectories" is the Certificate's

divergence/commitment result at the agent scale; §3.1's grounding cadence (re-ground on a schedule, don't wait for the drift alarm — it is provably late) is the direct prescription. The self-triggered-control framing (Heemels–Tabuada) applies. [confidence: Medium — the schedule is proven on synthetic maps + one reservoir, not on an agent trajectory · source: cert §3.1]

  • GAP. No trained tool-use / agentic-RL of our own; agency rides on rented base models.

MEASURED (2026-07-21): the autowork pipeline has not yet resolved a real issue end-to-end — live run autowork-2762-1784669597545 failed at apply after three patch regenerations with hallucinated context (its context lines weren't in the real file), and SWE-bench Lite single-shot sits at 0/5 ([#2762]). The diagnosed failure is a freshness failure at the Act seam: the retry regenerates from the same stale context, so the Grounding Ledger's own law (only fresh truth informs) prescribes the fix — re-slice the real file into each retry. The loop's Verify discipline diagnosing its weakest stage is the design cohering, and closing [#2762] is the highest-leverage open item.

VERIFY — grounding, collapse detection, honesty · the Certificate's home

The stage we actually own. External reality is the only thing that stops the loop degenerating — proven (in-regime) and measured across this document's sibling work.

  • Best practice (ESTABLISHED). RL with verifiable rewards (RLVR/GRPO) — reward from real

execution, no learnable reward model to hack (post-training 2026). Model-collapse literature — recursive training on unverified synthetic data degrades; verification prevents it (Shumailov Nature 2024; Feng et al. 2024). Hallucination/eval — contamination-free, date-annotated held-outs (LiveCodeBench), calibration/confabulation measurement.

  • OURS (the genuine contribution — but disciplined, not novel). The

Collapse Certificate: a machine-checked (in-regime) formalization that an ungrounded self-referential loop collapses or diverges (ThmCollapse Certificate/ C3), the discrete acceptance gate (ρ<1), the critical-slowing-down + Kalman-NIS canary, the honesty/calibration harness, and the Grounding Ledger — grounding has a price (only fresh truth selects), a schedule (§3.1 cadence), and a budget (§8.4). Honest scope: every mechanism is adopted from a standard field (Lyapunov, contraction analysis, self-triggered control, RLS forgetting, Thresholdout, simulated annealing) — see the cert's gap→conventional-grounding map. The contribution is disciplined in-repo formalization + honest measurement, not new theory.

  • IN-REPO. src/cio_sde/ (Thm 1, Σ₀, Σ₀⁻¹, JSRR gate); experiments/sigma0_*; the honesty

golden set + council;test suites /passing.

  • GAP. The Verify machinery is validated in simulation / one model / synthetic — *no real

training run has exercised it yet* (the E-B run, [#2691], is the pending real-model validation).

  • Worked example — the discipline on a live market surface (2026-07-18). The formal machinery

is still simulation-bound (the GAP above), but the principle it encodes — internal signals detect, only fresh truth informs — was run end-to-end on a real question: does single-stock 12-1 momentum upgrade the trader's champion? An internal signal said yes emphatically — an in-house backtest printed +33,937% (Sharpe 1.19); a "12-1 champion" printed ~$2M. Fresh external truth killed it: reconstructing the point-in-time S&Puniverse (including the delisted names Yahoo / Alpaca / IBKR / stooq-bulk all silently drop) and measuring survivorship-free gave Sharpe 0.60 (−54% maxDD, dead even with SPY, below the champion's 0.66). Independent confirmation arrived from outside the loop: arXiv:2603.19380 measures the identical bias (+4.94pp/yr overstatement) on a different index. The "$2M upgrade" was a survivorship mirage the freshness law predicts — a survivor-biased backtest is an internal signal that detects nothing wrong, and only fresh point-in-time truth informs. This is also the fresh-market-truth surface the reverse-engineering section names, exercised for real. Evidence: experiments/survivorship_momentum/ (FINDINGS.md), UNISONA-SHARPE-CERTIFICATE.md, research/2026-07-18-market-data-vendors-survivorship.md. [class: OURS (Verify) — the discipline, not the machinery, MEASURED on a real surface]

CONVERGE — how the system gets better over time

The meta-loop: turn verified experience into a better system. This is where post-training, continual learning, and the Certificate's slow-weights gate (Σ_θ) live.

  • Best practice (ESTABLISHED). Modular post-training: **SFT → preference-opt (DPO/SimPO/KTO)

→ verifiable-reward RL (GRPO/DAPO) — DPO is the de-facto alignment default, RLVR the reasoning lever; data quality dominates algorithm choice (post-training 2026; interconnects recipe). Continual updates risk forgetting; RL forgets less than SFT (KL-from-base). Scaling laws** set the compute/data budget (Chinchilla ~20 tokens/param).

  • In-repo (IN-REPO). The Σ_θ acceptance gate (7-condition release gate + A/B/C tree,

experiments/sigma_theta_abc/) — when a weight update may replace the incumbent; the E-B three-arm promotion protocol; QLoRA distillation + arm-C GRPO verified on Lightning L4 (#2231); distillation-to-ternary serving artifact (ADR-0026). "Persistent learning, not weight modification" is the project rule — improve via memory + retrieval first, retrain gated.

  • OURS (Verify-adjacent). Σ_θ is the Verify discipline applied to the slow weights: it does

not train the model, it gates the update against a fresh external anchor (the freshness law: internal signals detect, fresh randomness de-ratchets, only fresh truth informs). Honest: it is TRPO + Gao + Dwork + simulated-annealing imported, not a new gate.

  • GAP. We run no frontier post-training — no large SFT/DPO, no from-scratch RLVR training

loop, no MoE pretraining. Converge, for us, is currently distill a rented model + gate the update, not train a frontier model. Sourced against the full recipe above.


Cross-cutting layers (present at every stage; mostly gaps for us)

Layer Best practice (ESTABLISHED, 2026) Ours Source
Optimizer Muon replacing AdamW (~2× compute-efficient; DeepSeek V4-Pro adopts it) GAP — we use stock AdamW in QLoRA Muon arXiv:2502.16982
Data quality the binding constraint; rephrasing + human anchor + verifiable synthetic GAP — no pipeline; the E-B prep is a first eval/SFT-data step Toloka
Systems FP8, MoE expert-parallel, distributed schedulers GAP — single-L4 QLoRA only; 8GB local serves, cloud trains MoE inference
Scaling laws compute-optimal ~20 tok/param; predictive mixture laws GAP — we operate below the scaling regime scaling analysis
Serving quant (post-hoc INT4/ternary), speculative decoding, KV-cache IN-REPO — Ouro serve + ternary distill (ADR-0026); [[posthoc-quantization-cliff-measured]]

Reverse-engineering the frontier — the inverse-problem method (the black-hole telescope)

Status: FRAMING (the method is ESTABLISHED science; its application here is ours). Added 2026-07-18 with the operator's synthesis.

The frontier recipe — the unpublished data mixture, RL and systems tricks — is an ill-posed inverse problem: we cannot observe it directly, and infinitely many recipes are consistent with what we can observe. That is exactly the problem the Event Horizon Telescope solves to image a black hole: interferometry data admits infinitely many images, and Regularized Maximum Likelihood selects "a conservative image from an infinite number of possible images" — fitting the data while regularizing hard enough to never hallucinate structure the data doesn't support (EHT sparse modeling; M87 imaging).

The mapping, term by term:

EHT imaging Frontier reconstruction (this project)
sparse visibility data the frontier model's observable input→output behavior
RML forward-modeling distillation — recover the map from the black box's shadow
imaging the interior from indirect measurement probing — e.g. the linear honesty probe reading truth off hidden states
the regularizer (entropy/sparsity priors) grounding (the Certificate) — fit the observable capability, regularize to the established corpus, refuse to hallucinate the secret sauce
the conservative-image discipline the evidence-class discipline — the same one that refused a fake "novel mechanism" every time this session tested one

Reconstruction has a hard ceiling stated plainly: an inverse problem cannot add structure the data doesn't contain. Distilling the frontier reaches it asymptotically; it does not surpass it. To exceed the reconstruction you need an instrument the original doesn't have — fresh verified ground truth on domains the frontier has no cheap labels for: resolved market P&L, execution-verified code outcomes, real user corrections. That is the telescope they do not own, and the freshness law (only fresh truth selects) is why it is the only thing that can pull the student past the teacher — locally, on the surfaces that matter.

How we make AGI — the disciplined synthesis (operator-approved, 2026-07-18)

We do not make AGI by training a frontier-scale model from scratch; that path is closed by capital, data, and unpublished tacit knowledge. The open path is the one this document maps: rent the six load-bearing capabilities the frontier ships; own the one it is missing and names as its top failure (long-horizon grounding / anti-collapse); distill to a small, local, verifiable serving artifact; close the loop with fresh domain verification surfaces the frontier cannot cheaply replicate; and use the inverse-problem method above to reconstruct what they hide — then exceed it locally where our telescope sees truth theirs cannot. The Certificate's rule is unchanged and non-negotiable: no claimed edge, capability, or novelty counts until it survives fresh, out-of-sample verification on the actual surface. That is the plus-ultra that is actually beyond what they ship, because it is grounded.


The honest AGI-scope assessment

Could this become the best model possible? Not from what we own. Six of the seven load-bearing capabilities (data, architecture, optimizer, scaling, pretraining, frontier post-training, systems) are gaps we would fill with the outside research above, not with anything in-repo. That is not a failure — it matches theconsensus that the frontier is execution + data, and those are capital/compute problems more than idea problems. Scored in capability space (the cognitive-profile companion view below), the same verdict lands with sharper edges: sub-median or absent in at least three faculties (perception beyond text/images, social cognition, skill-retaining learning), unmeasured in two more (attention; metacognition externally).

What is genuinely ours, and where it matters: the Verify discipline (the Collapse Certificate

  • Grounding Ledger + Σ_θ gate), and its extension into Converge as the update gate. The bet that

pays off is not "we invented a better reasoner" — it is "we are the only stack that treats grounding/anti-collapse as a first-class, measured discipline across the whole loop," at exactly the moment the agentic frontier is naming un-grounded long-horizon collapse as its top unsolved failure. The architecture we already serve (Ouro LoopLM) is on the winning test-time-compute curve, and our Verify work is the stability layer that curve needs.

The strategy the loop implies:

  1. Rent the six gap capabilities — base models, their pretraining, their architecture — via the

provider chain and distillation. Do not try to out-pretrain frontier labs.

  1. Own Verify + Converge-gating — grounding cadence (Observe/Act), freshness-priced selection

(Converge), collapse detection (Reason), honesty measurement (Verify). This is the differentiated product surface (the AI cockpit that knows when it doesn't know).

  1. Distill, don't train from scratch — the ternary ≤8GB serving artifact (ADR-0026) + the

verify-gated update loop is the realistic path to an owned small model that inherits frontier capability and adds the grounding discipline.

  1. Close the one real-model gap — and race the frontier to instrument it. Run E-B ([#2691]) so the

Verify claims graduate from simulation to MEASURED-on-a-real-model and validate metacognition against the frontier's own emerging held-out metacognition evals ([#2776]; Burnell et al. arXiv:2605.28405 §4.1 — canon [07]). These must parallelize, not serialize: the faculty we own is the exact one DeepMind is now building held-out evals for, so the lead is real but shrinking. Until then, our edge is argued, not proven — and unproven against an external standard is worth less than proven against our own.

The trap (stated so it can't be laundered): treating a rigorous Verify layer as an AGI recipe. It is the seatbelt and the dashboard warning light — indispensable, and worthless without the engine, which we rent. The whole-loop win is rented capability + owned grounding, delivered as one convergent product, not a home-grown frontier model. And the moat is a lead, not a wall: the one faculty we own (metacognition) is the one the frontier has now named and is instrumenting — so the grounding discipline only stays a differentiator if it is measured against an external held-out standard before that standard becomes commodity.

The cognitive-profile companion view — ten faculties (added 2026-07-21, #2775)

The Observe→…→Converge structure above is a process decomposition; Burnell et al.'s cognitive taxonomy (arXiv:2605.28405 — canon [07]) is a capability decomposition, and the two are orthogonal. A capability with no loop stage never earns a GAP row — which is why attention (unmeasured) and social cognition (ceded) are invisible in the process assessment above. This companion scores v1.10 by faculty, using the blueprint's evidence classes plus CEDED (a deliberate product non-goal) and UNMEASURED (real, but no instrument yet). It is a mirror of the same honest assessment, not a new claim.

Faculty (Burnell et al. taxonomy) v1.10 status Basis
Perception (text) RENTED input understanding rides the base model; non-text perception is CEDED (below)
Generation (text) RENTED text generation is the base model's; speech generation is CEDED
Attention UNMEASURED no instrument; never surfaced as a stage, so it earns no process-side GAP row — eval plan tracked in [#2782]
Learning RENTED + partial OURS no frontier post-training (a GAP above); experiential learning via convergence records is ours-in-principle but simulation-bound; retention is measured (LongMemEval), skill acquisition is not — instrument tracked in [#2783]
Memory RENTED (parametric) + OURS (system) working knowledge is rented from base weights; the memory system (append-only JSONL + CSF archive + multi-signal retrieval) is ours — yet long-term-memory storage is the frontier's own named deficit (Hendrycks et al. arXiv:2510.18212)
Reasoning RENTED Ouro / base models; we do not train the reasoner
Metacognition OWNED the one faculty we instrument — mapping below
Executive functions partial OURS loop orchestration + the Σ_θ acceptance gate (inhibitory control) are ours; planning rides the base model
Problem solving RENTED rides base-model reasoning + our tool harness
Social cognition CEDED deliberate product non-goal (below)

Cessions on the record — deliberate product decisions for the AI cockpit, named the same way rented capabilities are (not silent omissions): speech generation, motor control, audio perception, social cognition. Ceding them is a scope choice, not a deficit to apologize for; naming them is what keeps the profile honest. Video perception is the one faculty still ungoverned either way — the in-repo analyze_video is the Creator Suite's motion/scene/audio highlight analyzer (a media-editing Act tool), not general dynamic-scene understanding; the cede-or-plan decision is the operator's call, tracked in [#2784].

Metacognition — the one OWNED faculty, restated in the externally-defined vocabulary:

  • confidence calibration ↔ the decision journal / calibration scoring
  • error monitoring ↔ the drift canaries (critical-slowing-down + Kalman-NIS)
  • source judgments ↔ convergence records ([claim, evidence, confidence, source])
  • knowledge of limitations ↔ the honesty / calibration probe
  • inhibitory control (an executive-function component) ↔ the Σ_θ acceptance gate (ρ<1) — withholding an un-grounded update

Why this belongs here: the process view can score a capability only where the loop already has a stage for it, so genuinely-unmeasured (attention) and genuinely-ceded (social cognition) faculties go missing from an otherwise rigorous honest-assessment section. The faculty view closes that blind spot — and it lands on the same conclusion as the process view: rented capability + owned grounding, with metacognition as the single owned faculty and the reason validation must now parallelize (strategy itemabove).


Evidence discipline (inherited, non-negotiable)

Every claim above carries a class (ESTABLISHED/IN-REPO/OURS/GAP) and a source. OURS is used sparingly and only for the Verify discipline, which is itself formalization-of-standard-methods (no novel mechanism — see the Certificate's 2026-07-18 gap→conventional-grounding map). External citations are venue- or arXiv-verifiable; the project's history of four fabricated arXiv IDs is why no ID here is cited unread. If a stage's "IN-REPO" pointer does not resolve, the blueprint has drifted and that row should be demoted to GAP until reconciled.