SourceReddit r/LocalLLaMA•Stalecollected in 4h
MoE Refusals Routed via Experts in Abliteration
#abliteration#moe-routing#refusal-subspaces#uncensorqwen3.5-397bqwen3.5-397bmac-studiomlxgateddeltanet
💡MoE abliteration secrets: experts hide safety refusals from baking
⚡ 30-Second TL;DR
What Changed
Separate subspaces: CN-political vs Western-safety refusals
Why It Matters
Enables precise uncensoring of local MoE models without losing safety. Reveals architecture-specific refusal mechanisms for future ablations.
What To Do Next
Run https://github.com/trevorgordon981/alfred-abliterate to ablate refusals in your Qwen MoE model.
Who should care:Researchers & Academics
Key Points
- •Separate subspaces: CN-political vs Western-safety refusals
- •Weight-baking fails safety due to pre-proj expert routing
- •397B MoE fragile—only top-16 directions work without loops
- •Adapted for GatedDeltaNet + MoE with Gram-Schmidt ortho
📰
Weekly AI Recap
Read this week's curated digest of top AI events →
👉Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/LocalLLaMA ↗
This is a summary, not the original. Read the source, or get the weekly briefing.
The weekly digest
One email a week. Unsubscribe anytime.