Search

Few direct matches — filled in with the latest updates.

Tag: #spiking-networks1 results

🤖

1B Pure SNN Scales from Scratch

18yo dev trains 1.088B parameter pure Spiking Neural Network for language modeling from random init, converging to loss 4.4 after 27k steps. Exhibits 93% sparsity, untargeted Russian emergence, and self-shifting 39% activations to memory. Full code and 12GB checkpoint released on GitHub.

Reddit r/MachineLearningCommunityApr 13#spiking-networks#neuromorphic#sparsity