Predict GPT-2 Edges from Weights Alone

What Changed

ρ=0.623 Spearman correlation with path patching

Why It Matters

Enables fast prioritization of edges for investigation or pruning in transformer circuits, saving compute on causal scrutiny. Promising for scaling mechanistic interpretability.

What To Do Next

Compute Cheap Anchor scores on your transformer model's induction heads using the described spectral and path metrics.