Uncensored Qwen3.5-27B with KL Fix
💡Uncensored 27B model holds 262K ctx, 97% HumanEval—test on your 12GB GPU now
⚡ 30-Second TL;DR
What Changed
96.91% HumanEval benchmark score
Why It Matters
Enables high-performance uncensored 27B model on consumer GPUs like RTX 3060. Supports long-context roleplay and tasks locally, though slow at 4 tok/sec.
What To Do Next
Download Q4_K_M GGUF from HuggingFace and test 262K context in llama.cpp.
Key Points
- •96.91% HumanEval benchmark score
- •KL divergence reduced from 1.14 to 0.28
- •Holds 262K context in conversations
- •Q4_K_M quant with layer fixes
- •No additional training required
🧠 Deep Insight
AI-generated analysis for this event — not the original article.
🔑 Enhanced Key Takeaways
- •The 'KL Fix' refers to a specific intervention in the model's attention and feed-forward network layers to mitigate catastrophic forgetting and distribution drift introduced during the Claude Opus dataset fine-tuning process.
- •The 262K context window is achieved through a combination of RoPE (Rotary Positional Embedding) scaling and a custom KV-cache compression technique that maintains coherence beyond the original Qwen3.5 training limit.
- •The model utilizes a MoE (Mixture of Experts) architecture, where the 'attn_v' and 'ffn_gate_exps' layer adjustments were necessary to re-align expert routing probabilities that were disrupted by the uncensoring process.
📊 Competitor Analysis▸ Show
| Feature | Qwen3.5-27B (Uncensored) | Llama 3.3-70B (Instruct) | Mistral Large 2 |
|---|---|---|---|
| Architecture | MoE (27B) | Dense (70B) | Dense (123B) |
| HumanEval | 96.91% | 92.4% | 91.8% |
| Context Window | 262K | 128K | 128K |
| Licensing | Apache 2.0 (Base) | Llama 3.3 Community | Proprietary |
🛠️ Technical Deep Dive
- Architecture: Mixture-of-Experts (MoE) with 27B total parameters, utilizing sparse activation for inference efficiency.
- KL Divergence Optimization: The reduction from 1.14 to 0.28 was achieved by applying a Kullback-Leibler divergence penalty during the merging process to keep the fine-tuned weights anchored to the original Qwen3.5 distribution.
- Quantization: GGUF format optimized for llama.cpp, specifically targeting Q4_K_M to balance perplexity loss with VRAM footprint.
- Layer Fixes: Targeted adjustment of 'attn_v' (attention value) and 'ffn_gate_exps' (feed-forward network gate experts) to correct output logit bias introduced by the removal of safety alignment filters.
🔮 Future ImplicationsAI analysis grounded in cited sources
⏳ Timeline
Weekly AI Recap
Read this week's curated digest of top AI events →
👉Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/LocalLLaMA ↗
This is a summary, not the original. Read the source, or get the weekly briefing.
The weekly digest
One email a week. Unsubscribe anytime.