Cohere releases Apache 2.0 open-weight model Command A+

๐กFirst Apache 2.0 frontier-grade MoE model optimized for local deployment and complex reasoning.
โก 30-Second TL;DR
What Changed
218B parameter sparse MoE architecture with only 25B active parameters per step.
Why It Matters
This release enables enterprises to run frontier-grade reasoning models on-premises, reducing dependency on proprietary cloud APIs. It sets a new standard for open-source models that prioritize hardware efficiency and sovereign data control.
What To Do Next
Download the Command A+ weights from Hugging Face and benchmark the W4A4 quantization performance against your current local inference setup.
Key Points
- โข218B parameter sparse MoE architecture with only 25B active parameters per step.
- โขReleased under a permissive Apache 2.0 license on Hugging Face for sovereign AI deployment.
- โขSupports advanced quantization formats including W4A4 to minimize memory footprint without sacrificing reasoning quality.
๐ง Deep Insight
Web-grounded analysis with 22 cited sources.
๐ Enhanced Key Takeaways
- โขCommand A+ is the final model in the Command A family and Cohere's inaugural Mixture-of-Experts (MoE) model, integrating vision inputs alongside text for multimodal capabilities.
- โขThe model significantly expands multilingual support to 48 languages, encompassing all official EU languages, which more than doubles the language coverage of previous Cohere models.
- โขOptimized for production-grade deployments, Command A+ can be deployed efficiently on minimal hardware, requiring as few as one B200 or two H100 GPUs, and demonstrates up to a 110% increase in throughput and a 30% decrease in latency compared to Command A Reasoning.
- โขIts Apache 2.0 license is specifically designed to facilitate sovereign AI deployments, offering governments and regulated industries full transparency, control, and the ability to deploy on-premises or in private clouds without external data transmission.
- โขCommand A+ is noted for its strong performance in pure reasoning and mathematics, competing with larger models like DeepSeek V4 Pro, although it currently trails some Chinese open-source rivals in deep agentic coding and general intelligence indexing.
๐ Competitor Analysisโธ Show
| Feature/Model | Cohere Command A+ | Qwen3.6-35B-A3B | GPT-OSS-120B | Google Gemini 3 Pro (Proprietary) |
|---|---|---|---|---|
| Total Parameters | 218 Billion | 35 Billion | 117 Billion | Sparse MoE (details not specified) |
| Active Parameters | 25 Billion | 3 Billion | 5.1 Billion | Sparse MoE (details not specified) |
| License | Apache 2.0 | Open Weights (permissive) | Apache 2.0 | Proprietary |
| Key Optimizations/Features | Multimodal, Agentic, Reasoning, Multilingual (48 langs), W4A4 Quantization | Agentic Coding, Multimodal Perception, Reasoning | Reasoning, Consistent Structured Responses, MXFP4 Quantization | Multimodal (text, image, audio, video), Agentic, Long Context Reasoning |
| Hardware Requirements (Min.) | 1 x B200 or 2 x H100s (W4A4) | Not specified, but efficient | 1 x H100 or AMD MI300X 80GB GPU | Runs on Google TPUs |
| Context Length (Input) | 128K tokens | Not specified | Not specified | 1 Million tokens |
| Output Length (Max) | 64K tokens | Not specified | Not specified | 64K tokens |
| Benchmarks | Competes with DeepSeek V4 Pro on math; trails some Chinese rivals in agentic coding/general intelligence | Outperforms Qwen3.5-35B-A3B, rivals larger dense models | Strong reasoning capability | Improves over Gemini 2.5 Pro, competitive with GPT 5.1 and Claude Sonnet 4.5 on reasoning, multimodal, coding benchmarks |
๐ ๏ธ Technical Deep Dive
- Architecture: Decoder-only Sparse Mixture-of-Experts (MoE) Transformer Model.
- Expert Configuration: Comprises 128 experts, with 8 experts actively engaged per token, and includes a single shared expert applied to all tokens.
- Attention Mechanism: Features interleaved sliding-window attention layers with Rotational Positional Embeddings and global attention layers without positional embeddings, arranged in a 3:1 ratio, a design inherited from Command A.
- MoE Training: Utilizes a fully dropless training approach and a token-choice router for expert selection.
- Quantization Support: Offers support for BF16, FP8, and W4A4 quantization formats, with W4A4 being the recommended choice for its superior speed, latency, and reduced hardware footprint without significant quality degradation.
- Context Window: Supports an input context length of 128,000 tokens and a maximum output length of 64,000 tokens.
- Multimodal Capability: Integrates native support for vision inputs, allowing the model to process both text and images.
- Deployment Efficiency: Designed for high-performance inference on as few as one NVIDIA B200 or two NVIDIA H100 GPUs when utilizing W4A4 quantization.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (22)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: VentureBeat โ

