來源Reddit r/LocalLLaMA•較早收集於 5h
無審查 Qwen3.5-27B 含 KL 修復
#uncensored#model-merge#long-contextqwen3.5-27b-claude-4.6-opus-uncensored-v2qwen3.5claude-opusggufhuggingface
💡無審查 27B 模型持 262K 上下文、97% HumanEval—立即在你的 12GB GPU 測試
⚡ 30 秒速覽
有什麼變化
96.91% HumanEval 基準分數
為什麼重要
讓如 RTX 3060 的消費者 GPU 運行高效無審查 27B 模型。支援本地長上下文角色扮演與任務，雖僅 4 tok/sec。
下一步行動
從 HuggingFace 下載 Q4_K_M GGUF，並在 llama.cpp 中測試 262K 上下文。
誰應關注：Developers & AI Engineers
關鍵要點
- •96.91% HumanEval 基準分數
- •KL 散度從 1.14 降至 0.28
- •對話中持 262K 上下文
- •Q4_K_M 量化含層修復
- •無需額外訓練
🧠 深度解析
本篇為 AI 生成分析，非原文內容。
🔑 增強重點摘要
- •The 'KL Fix' refers to a specific intervention in the model's attention and feed-forward network layers to mitigate catastrophic forgetting and distribution drift introduced during the Claude Opus dataset fine-tuning process.
- •The 262K context window is achieved through a combination of RoPE (Rotary Positional Embedding) scaling and a custom KV-cache compression technique that maintains coherence beyond the original Qwen3.5 training limit.
- •The model utilizes a MoE (Mixture of Experts) architecture, where the 'attn_v' and 'ffn_gate_exps' layer adjustments were necessary to re-align expert routing probabilities that were disrupted by the uncensoring process.
📊 競品分析▸ Show
| Feature | Qwen3.5-27B (Uncensored) | Llama 3.3-70B (Instruct) | Mistral Large 2 |
|---|---|---|---|
| Architecture | MoE (27B) | Dense (70B) | Dense (123B) |
| HumanEval | 96.91% | 92.4% | 91.8% |
| Context Window | 262K | 128K | 128K |
| Licensing | Apache 2.0 (Base) | Llama 3.3 Community | Proprietary |
🛠️ 技術深入
- Architecture: Mixture-of-Experts (MoE) with 27B total parameters, utilizing sparse activation for inference efficiency.
- KL Divergence Optimization: The reduction from 1.14 to 0.28 was achieved by applying a Kullback-Leibler divergence penalty during the merging process to keep the fine-tuned weights anchored to the original Qwen3.5 distribution.
- Quantization: GGUF format optimized for llama.cpp, specifically targeting Q4_K_M to balance perplexity loss with VRAM footprint.
- Layer Fixes: Targeted adjustment of 'attn_v' (attention value) and 'ffn_gate_exps' (feed-forward network gate experts) to correct output logit bias introduced by the removal of safety alignment filters.
🔮 前景展望基於引用來源的 AI 分析
Community-driven 'KL Fix' techniques will become standard for merging uncensored models.
The success of this method in maintaining benchmark performance while removing safety filters provides a repeatable template for open-source model developers.
27B parameter models will surpass 70B models in specialized coding tasks by Q4 2026.
The high HumanEval score of this 27B model demonstrates that architectural efficiency and high-quality synthetic data can outperform sheer parameter count.
⏳ 時間線
2025-09
Alibaba releases the base Qwen3.5 model series.
2026-01
Initial community experiments begin on uncensoring Qwen3.5 using Claude Opus synthetic datasets.
2026-03
Release of the 'KL Fix' patch to address distribution drift and performance degradation in merged models.
📰
AI 週報
閱讀本週精選 AI 大事摘要 →
👉相關動態
AI 策展新聞聚合。所有內容版權歸原始發布者所有。
原始來源： Reddit r/LocalLLaMA ↗
每週電子報
每週一封，可隨時退訂。