Verified neural compilation of RoPE and gauge equivalences in transformers.
Transformer weights admit non-trivial symmetries — RoPE-commuting rotations, sign / phase gauges, parabolic stabilizers, observable quotients, and probe-induced fake equivalences — under which the function the network computes is preserved exactly or up to a measured budget. This survey catalogs the ones we have isolated so far, with each formalised as a Lean theorem and each fake symmetry surfaced as a refinement test against finer probes.
Symmetry catalog
One card per discovered symmetry. Each links to its detail page with the full invariant, derivation, and Lean theorem list.
Interactive invariants
Three working demos — slider-driven, no frameworks. Each illustrates one symmetry class from the catalog. Move a control, the invariant holds live.
Proof status
Per-symmetry counts, auto-populated from
_data/lean_status.json.
| Symmetry | Proven | Deferred | Axiomatic | Stub | Total | Distribution |
|---|---|---|---|---|---|---|
Paper & code
Manuscript, source, and formal proofs. Cite as below.
@article{basu2026symmetry,
title = {Symmetry Survey for Verified Neural Compilation},
author = {Basu, Debanjan},
year = {2026},
note = {Lean 4 companion at github.com/d3banjan/symmetry-survey-paper}
}