Verified neural compilation of RoPE and gauge equivalences in transformers.
Transformer weights admit non-trivial symmetries under which the function computed by the network is preserved exactly, or up to a measured error budget. This survey catalogs the ones we have isolated so far — RoPE-commuting rotations, sign/phase gauges, parabolic stabilizers, observable quotients, and probe-induced fake equivalences — each formalised as a Lean theorem, with each fake symmetry exposed by refining the probe family.
Symmetry catalog
One card per discovered symmetry. Each links to its detail page with the full invariant, derivation, and Lean theorem list.
Interactive invariants
Three working demos — pure JS, no frameworks. Each illustrates one symmetry class from the catalog. Move a control and the invariant updates in real time.
Proof status
Per-symmetry counts, auto-populated from
_data/lean_status.json · last build:
| Symmetry | Proven | Deferred | Axiomatic | Stub | Total | Distribution |
|---|---|---|---|---|---|---|
Paper & code
Manuscript, source, and formal proofs. Cite as below.
@article{basu2026symmetry,
title = {Symmetry Survey for Verified Neural Compilation},
author = {Basu, Debanjan},
year = {2026},
note = {Lean 4 companion at github.com/d3banjan/symmetry-survey-paper}
}