Unsloth Fixes Qwen3.5-35B Tool Calling

🔑 Enhanced Key Takeaways

• •Unsloth's Dynamic quants for Qwen3.5-35B achieve state-of-the-art (SOTA) performance on nearly all bit widths, validated by over 150 KL Divergence benchmarks across 9TB of GGUFs[1][2].
• •The tool-calling fix addresses a chat template bug universally, impacting all Qwen3.5 formats and uploaders, not limited to Unsloth's GGUF quants[1][2].
• •Unsloth is retiring MXFP4 layers from specific Qwen3.5 GGUFs (Q2_K_XL, Q3_K_XL, Q4_K_XL) due to benchmark findings[1].

🛠️ Technical Deep Dive

• •Unsloth Dynamic 2.0 GGUFs for Qwen3.5-35B show 99.9% KL Divergence on the Pareto Frontier, outperforming alternatives in accuracy and size (e.g., dynamic 4bit version is 2GB smaller with +1% accuracy vs QAT)[2][3].
• •Optimal quantization targets ffn_up_exps, ffn_gate_exps at 3bit (e.g., iq3_xxs) for best disk space and KLD balance; avoid heavy quantization on ssm_out due to high KLD increase[2].
• •Qwen3.5-35B-A3B recommended over 27B for faster inference when hardware fits, while 27B prioritizes slight accuracy gains[1].

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline