π€Reddit r/MachineLearningβ’Stalecollected in 15h
1B Pure SNN Scales from Scratch
π‘1B SNN LM converges from scratch w/ 93% sparsity β code + checkpoint free!
β‘ 30-Second TL;DR
What Changed
93% sparsity, 7% neurons fire per token
Why It Matters
Demonstrates viability of massive SNNs from scratch, unlocking energy-efficient neuromorphic inference for language tasks.
What To Do Next
Download the 12GB SNN checkpoint from GitHub to experiment with sparsity.
Who should care:Researchers & Academics
Key Points
- β’93% sparsity, 7% neurons fire per token
- β’Cross-lingual Russian text emergence at 25k steps
- β’39% activation routing to memory at 1B scale
- β’Pure spike-domain training, no ANN conversion
π°
Weekly AI Recap
Read this week's curated digest of top AI events β
πRelated Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning β
This is a summary, not the original. Read the source, or get the weekly briefing.
Weekly AI briefing
One email a week. Unsubscribe anytime.