Stepfun Open-Sources Step 3.7 Flash LLM for Agents

๐กHigh-speed 196B MoE model with native tool-calling designed specifically for agentic AI workflows.
โก 30-Second TL;DR
What Changed
196B-parameter sparse MoE architecture optimized for agent workflows
Why It Matters
This release provides developers with a high-performance, open-source alternative for building responsive agentic systems. Its speed and tool-calling focus could significantly reduce latency in real-time AI applications.
What To Do Next
Download the Step 3.7 Flash weights and benchmark its tool-calling latency against your current production model to evaluate potential performance gains.
Key Points
- โข196B-parameter sparse MoE architecture optimized for agent workflows
- โขHigh-speed inference performance reaching 400 tokens/s
- โขNative support for complex tool-calling and agentic tasks
๐ง Deep Insight
Web-grounded analysis with 18 cited sources.
๐ Enhanced Key Takeaways
- โขStep 3.7 Flash is a multimodal vision-language model, integrating a 196B-parameter language backbone with a 1.8B-parameter vision encoder for native image and video understanding, enabling it to process diverse visual inputs like UI elements, charts, and documents.
- โขThe model operates with a sparse Mixture-of-Experts (MoE) architecture, activating approximately 11 billion parameters per token during inference, which contributes to its high efficiency and a reported throughput of up to 400 tokens per second.
- โขIt features selectable reasoning levels (low, medium, and high), allowing developers to dynamically adjust the trade-off between inference speed, operational cost, and the depth of cognitive processing required for specific agentic tasks.
- โขStep 3.7 Flash demonstrates strong performance in agentic reliability and multimodal perception, leading the ClawEval-1.1 benchmark with a score of 67.1 and achieving top-tier visual intelligence on SimpleVQA (Search) with 79.2.
- โขThe model is designed for broad compatibility with major agent frameworks, including Claude Code, KiloCode, RooCode, OpenCode, Hermes Agent, and OpenClaw, and supports MCP and Skills tool-calling protocols, significantly reducing integration complexity for developers.
๐ Competitor Analysisโธ Show
| Feature / Model | Step 3.7 Flash | Claude Opus 4.6/4.8 | GPT-5.4/5.5 Pro | Grok 4.3 | DeepSeek V4 Flash | Gemini 3.1 Pro/3.5 Flash |
|---|---|---|---|---|---|---|
| Architecture | 196B sparse MoE (11B active), Vision-Language | - | - | - | 284B (MoE implied) | MoE implied |
| Parameters (Active) | 11B active | - | - | - | - | - |
| Inference Speed | 400 tokens/s | - | - | - | - | - |
| Context Window | 256K tokens | 1M tokens | 1M+ tokens | 1M tokens | 1M tokens | 1M tokens (Gemini 1.5 Pro) |
| Multimodal | Native image/video understanding | Text, image, file inputs | Text, image inputs | Text, image inputs | - | Multimodal (video/voice/text) |
| Agentic Focus | Optimized for agent workflows, tool-calling, coding, search | Highly autonomous agents, long-horizon work, multi-step reasoning, complex coding | Long-horizon problem solving, agentic coding, multi-step workflows | Agentic workflows, instruction-following | Agentic Coding, Agentic Browser-Use | Consumer agents, video/voice interaction, complex logic puzzles |
| ClawEval-1.1 Score | 67.1 | 70.8 (Opus 4.6) | 60.3 (GPT 5.4) | - | 57.8 | 57.8 (Gemini 3.1 Pro) |
| SWE-Bench Verified Score | 73.7% (with Advisor Mode) | 78.7% (Opus 4.6) | - | - | - | - |
| Pricing (API) | Input $0.20/M, Output $1.15/M | - | - | Tiered pricing for >200k tokens | Input $0.1/M, Output $0.4/M (Qwen3-Coder) | Cost-efficient (Flash models) |
| Open-Source | Yes (Apache 2.0) | No | No | No | Yes | No |
๐ ๏ธ Technical Deep Dive
- Architecture: Step 3.7 Flash is a 198B-parameter sparse Mixture-of-Experts (MoE) vision-language model. It combines a 196B-parameter language backbone with a 1.8B-parameter vision encoder.
- Active Parameters: During inference, approximately 11 billion parameters are activated per token, contributing to its efficiency.
- Multimodal Capabilities: The integrated vision encoder enables native image and video understanding, allowing the model to process and convert complex visual information from UIs, charts, and documents into structured outputs or code.
- Context Window: The model supports a 256K token context window.
- Inference Optimization: It is engineered for high-frequency production workloads, achieving a throughput of up to 400 tokens per second. Optimizations include MTP-3 Acceleration (3-way Multi-Token Prediction) and a 3:1 Sliding Window Attention ratio for efficient long-context processing.
- Reasoning Levels: Developers can choose from three selectable reasoning levels (low, medium, high) to balance speed, cost, and cognitive depth.
- Tool Calling & Orchestration: Features reliable native tool calling, allowing it to stably invoke APIs, browsers, terminals, Office tools, and external systems in multi-turn agent workflows. It is compatible with major agent frameworks and protocols like MCP and Skills.
- Advisor Mode: To enhance quality without sacrificing efficiency, Step 3.7 Flash supports an 'Advisor Mode.' In this mode, the model acts as an executor, escalating to a larger advisor model only at critical inflection points (e.g., complex planning or error recovery) to maintain high performance at reduced cost.
- Deployment: The model is open-sourced and available on platforms like GitHub, Hugging Face, and ModelScope. It can be deployed via Stepfun's API or with open-source frameworks such as SGLang, NVIDIA TensorRT-LLM, and vLLM on NVIDIA-accelerated infrastructure (Blackwell, Hopper GPUs).
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (18)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Pandaily โ
