Qwen3-Coder-Next 解析器修復
💡Quick parser fix for Qwen3-Coder-Next—run smoother local coding inference now
⚡ 30-Second TL;DR
有什麼變化
專門針對 Qwen3-Coder-Next 模型的解析器修復。
為什麼重要
Qwen3-Coder-Next 的解析器已發布修復。此修復解決 Qwen Next 系列問題。由社群貢獻者提交。
下一步行動
Update your llama.cpp repo to pull the latest Qwen3-Coder-Next parser fix.
關鍵要點
- •專門針對 Qwen3-Coder-Next 模型的解析器修復。
- •Qwen Next 系列持續改進的一部分。
- •Reddit 使用者 jacek2023 的社群驅動更新。
🧠 深度解析
背景與延伸：來自公開資料，非原文內容。引用 5 個來源。
🔑 增強重點摘要
- •The parser issue in Qwen3-Coder-Next stemmed from an incorrect 'tool_parser_type': 'json_tools' in tokenizer_config.json, which should be 'qwen3_coder' for XML-style tool calls; a one-line edit in the local HuggingFace cache fixes it.[1]
- •Community workaround involves manually changing the config file in ~/.cache/huggingface/hub/models--mlx-community--Qwen3-Coder-Next-4bit, but it must be reapplied after cache deletion or model redownload.[1]
- •Related stability issues in llama.cpp include premature EOS token generation after colons in tool calls due to newline trimming, fixed by adding newlines or autoparser branch updates.[2]
- •Qwen3-Coder-Next experiences crashes, segmentation faults, and performance problems across llama-server, CUDA, ROCm, and Windows in llama.cpp environments.[2]
- •The model is designed for coding agents, built on Qwen3-Next-80B-A3B-Base, with support for tool calls, fill-in-the-middle code insertion, and long contexts up to 65536 tokens.[5]
🛠️ 技術深入
- Parser Mismatch: tokenizer_config.json specifies 'json_tools' expecting raw JSON, but Qwen3-Coder-Next outputs XML-style <tool_call><function=...>, causing parse failures in mlx-lm.server.[1]
- Fix Implementation: Edit cached tokenizer_config.json to set 'tool_parser_type': 'qwen3_coder'; restart server enables correct parsing of tool calls like <tool_call><function=read_file>{"path": "main.py"}</tool_call>.[1]
- Related Bug in llama.cpp: Premature EOS after ':' in tool preambles due to newline trimming; workaround adds two newlines to assistant messages.[2]
- Architecture: Built on Qwen3-Next-80B-A3B-Base; supports apply_chat_template for messages, max_new_tokens=65536, FIM (fill-in-the-middle) with <|fim_prefix|>, <|fim_suffix|>, <|fim_middle|> tokens.[5]
- Usage Example: tokenizer.apply_chat_template(messages, tokenize=False, tools=tools) for tool-enabled inference; generate with do_sample=False for deterministic code completion.[5]
🔮 前景展望AI analysis grounded in cited sources
The parser fix and related community patches highlight ongoing integration challenges for specialized coding models like Qwen3-Coder-Next in local inference frameworks (mlx-lm, llama.cpp), potentially accelerating adoption in agentic coding tools but underscoring need for upstream config corrections by model authors to reduce user friction.
⏳ 時間線
📎 來源 (5)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
AI 週報
閱讀本週精選 AI 大事摘要 →
👉相關動態
AI 策展新聞聚合。所有內容版權歸原始發布者所有。
原始來源： Reddit r/LocalLLaMA ↗
每週 AI 簡報
每週一封，可隨時退訂。