MiniMax teases M3 model with 15.6X faster long-context speed

๐กDiscover how MiniMax's new sparse attention mechanism achieves a 15.6X speed boost for long-context AI agents.
โก 30-Second TL;DR
What Changed
MiniMax M3 will feature a custom sub-quadratic sparse attention framework.
Why It Matters
This breakthrough in decoding speed significantly lowers the barrier for deploying complex, long-context AI agents in enterprise production environments.
What To Do Next
Review the MiniMax M2 technical report to understand their MoE routing strategies for optimizing your own model fine-tuning workflows.
Key Points
- โขMiniMax M3 will feature a custom sub-quadratic sparse attention framework.
- โขThe M2 series uses a Mixture-of-Experts (MoE) architecture with 229.9B total parameters.
- โขM2 achieves efficiency by activating only 9.8B parameters per token across 256 experts.
- โขThe new M3 architecture aims to make ultra-long-context AI agent deployment economically viable.
๐ง Deep Insight
Web-grounded analysis with 13 cited sources.
๐ Enhanced Key Takeaways
- โขMiniMax, a Chinese AI startup founded in late 2021 or early 2022 by former SenseTime executives, went public on the Hong Kong Stock Exchange in January 2026.
- โขPrior to its IPO, MiniMax successfully raised $1.5 billion across seven funding rounds, with Alibaba emerging as the largest external shareholder and Hillhouse Capital as the earliest investor.
- โขThe M2 series, including the M2.7 model, has demonstrated strong performance in agentic and coding benchmarks, with M2.7 scoring 86.2% on PinchBench and ranking highly among open-source models globally.
- โขBeyond the 15.6x decoding speedup, MiniMax's M3 model is also projected to achieve a 9.7x faster prefill speed specifically at 1-million-token context lengths compared to M2.
- โขThere are indications from MiniMax's head of engineering that the M3 model, along with other tools like Mavis and Teams, may be released as open-source.
๐ Competitor Analysisโธ Show
| Feature/Model | MiniMax M2.7 | MiniMax M1-80k | Claude Opus 4.6 | GPT-5.4 | GLM-5 | Qwen3.5-plus | GPT-oss 120B |
|---|---|---|---|---|---|---|---|
| Architecture | MoE (229.9B total, 9.8B active) | MoE, Hybrid-Attention (456B total, 45.9B active) | - | - | - | MoE | MoE (117B total, 5.1B active) |
| Long Context | - | 1M tokens native support | - | - | - | - | - |
| PinchBench (Agent Tasks) | 86.2% (5th overall) | - | >86.2% (implied higher than M2.7) | 86.4% | 86.4% | 85.8% | - |
| Kilo Bench (Autonomous Coding) | 47% (2nd overall) | - | - | - | - | >47% (implied higher than M2.7) | - |
| MMLU | 85.0% (M2.5) | - | 88.5% | - | 86.7% | 85.5% | 91.8% |
| Cost (per M tokens) | $0.30 input / $1.20 output | - | Much higher than M2.7 (implied) | Much higher than M2.7 (implied) | - | - | - |
๐ ๏ธ Technical Deep Dive
- The M2 series employs a sparse Mixture-of-Experts (MoE) decoder-only Transformer architecture, featuring 229.9 billion total parameters with only 9.8 billion parameters activated per token across 256 experts.
- MiniMax optimized routing in M2 by implementing sigmoid gating paired with learnable, expert-specific bias terms.
- While M2 development rigorously tested sub-quadratic shortcuts, they were initially discarded due to concerns about crippling the model's 'multi-hop reasoning' capabilities, leading to the adoption of full quadratic attention to maintain intelligence.
- The M3 model's custom sub-quadratic sparse attention framework is designed to perform attention directly on the real KV cache, rather than operating in compressed dimensions, which is a distinction from approaches like DeepSeek V4's CSA.
- MiniMax's M2.1, an open-source model, was developed with post-training optimization and utilizes an internal framework called 'Forge' specifically for agent-centric scenarios.
- The training for M2.1 involved agent-driven automated data pipelines that leveraged raw GitHub data to generate diverse and verifiable software engineering datasets and environments.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (13)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: VentureBeat โ
