Search

Tag: #efficiency28 results

GHOST Prunes Mamba2 Hidden States Efficiently

GHOST Prunes Mamba2 Hidden States Efficiently

GHOST applies structured pruning to Mamba2 using forward-pass controllability and observability metrics, avoiding backpropagation. Achieves 50% state reduction with ~1 PPL rise on WikiText-2 across 130M-2.7B models. Code available anonymously.

ArXiv AIResearchFeb 13#research#ghost#mamba2
Page 3 of 3