1B Pure SNN Scales from Scratch
18yo dev trains 1.088B parameter pure Spiking Neural Network for language modeling from random init, converging to loss 4.4 after 27k steps. Exhibits 93% sparsity, untargeted Russian emergence, and self-shifting 39% activations to memory. Full code and 12GB checkpoint released on GitHub.






