LLMs Think in Geometry, Not Language

🔑 Enhanced Key Takeaways

• •The research builds upon the 'Representation Engineering' (RepE) framework, which posits that internal model states can be manipulated as geometric vectors to steer model behavior without retraining.
• •Cross-lingual alignment is achieved through a phenomenon known as 'semantic isomorphism,' where the model's high-dimensional manifold preserves relative distances between concepts regardless of the linguistic tokenization path.
• •The findings suggest that 'concept-based' interpretability tools can be developed to perform model editing by directly modifying these geometric coordinates, effectively bypassing the need for natural language prompts.

🛠️ Technical Deep Dive

• •The study utilizes Principal Component Analysis (PCA) and t-SNE to project high-dimensional hidden states (typically from layers 15-25 in 30B+ parameter models) into a 3D manifold.
• •The convergence is measured using Procrustes analysis, which aligns the vector spaces of different languages to demonstrate that the geometric 'shape' of a concept remains invariant.
• •The implementation involves extracting activations from the residual stream at specific mid-layer indices, which are then normalized to account for variance in token frequency across different languages.
• •The research demonstrates that even with obfuscated variable names in Python code, the model maps the underlying logic to the same geometric region as the corresponding mathematical LaTeX representation.

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline