The Architecture Atlas

Fourteen ways past the Transformer.

Every architecture below answers a specific failure of the one before it: quadratic attention and its growing KV-cache pushed the field to fixed-state recurrence Phase 1, then to adaptive test-time compute inside a latent loop Phase 2, and finally away from causal autoregression altogether Phase 3. Click any node to open its dossier. This map is the living companion of the survey in preparation.

↑ Select an architecture on the timeline to read its dossier.

Master comparison

All fourteen, side by side.

Click a column header to sort. “Inference / token” is the marginal cost of generating one more token at context length N.

Compiled from the primary papers linked in each dossier; the survey in preparation gives the full derivations under a unified notation.