Qwen 3.5 122B-A10B Shocks Reasoning

🔑 Enhanced Key Takeaways

• •Qwen3.5-122B-A10B is a multimodal vision-language model supporting text, image, and video inputs for agent applications.[3]
• •Released on February 24, 2026, by Alibaba as part of the Qwen3.5 family, emphasizing efficiency with 10B active parameters out of 122B total.[6]
• •Achieves strong benchmarks like 58.6 on SuperGPQA and leads in BFCL-V4 and BrowseComp for agentic tasks.[2][4]

🛠️ Technical Deep Dive

• •Total parameters: 122B, active parameters: 10B; Mixture-of-Experts with 256 experts (8 routed + 1 shared).[2][3]
• •Architecture: 48 layers, hidden dimension 3072, hidden layout 12 × (3 × (Gated DeltaNet → MoE) → 1 × (Gated Attention → MoE)); Gated DeltaNet uses 64 linear attention heads for V and 16 for QK (head dim 128).[2]
• •Gated Attention: 32 heads for Q and 2 for KV (head dim 256), RoPE dim 64; context length 262,144 tokens natively, extensible to 1,010,000 with YaRN.[2][3]
• •Vocabulary size: 248,320; supports function calling, vision, and reasoning; optimized for NVIDIA GPUs (Ampere, Hopper, Blackwell).[1][3]
• •Pricing on OpenRouter: $0.40/M input tokens, $2.00/M output tokens; output speed ~154.5 tokens/second.[1][7]

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline