Hierarchos: A 232M Parameter Recurrent Memory-Augmented Assistant Model
Hierarchos is an experimental 232M-parameter language model that utilizes a hybrid non-Transformer architecture to achieve instruction coherence. It combines RWKV recurrence, hierarchical manager/worker loops, and differentiable slot-based long-term memory to prove efficiency in small-scale models.





