โ๏ธAWS Machine Learning BlogโขStalecollected in 2m
NVIDIA Nemotron 3 Ultra launches on Amazon SageMaker JumpStart
๐กDeploy NVIDIA's latest reasoning model on AWS with 5x faster inference and 30% lower costs for agentic AI.
โก 30-Second TL;DR
What Changed
Available for immediate deployment on Amazon SageMaker JumpStart
Why It Matters
This release lowers the barrier for enterprises to deploy high-performance reasoning models in production. It specifically targets the efficiency needs of agentic AI applications, which are becoming critical for automated business processes.
What To Do Next
Deploy a test instance of Nemotron 3 Ultra on SageMaker JumpStart to benchmark your existing agentic AI workflows for cost and latency improvements.
Who should care:Developers & AI Engineers
Key Points
- โขAvailable for immediate deployment on Amazon SageMaker JumpStart
- โขDelivers 5x faster inference speeds for agentic AI workloads
- โขReduces operational costs by 30% compared to previous configurations
๐ง Deep Insight
Web-grounded analysis with 15 cited sources.
๐ Enhanced Key Takeaways
- โขNVIDIA Nemotron 3 Ultra is a 550-billion-parameter Mixture-of-Experts (MoE) model with 55 billion active parameters, specifically engineered for frontier reasoning and orchestration in complex agentic AI systems.
- โขThe model incorporates a sophisticated hybrid Mamba-Attention architecture, leveraging LatentMoE for enhanced accuracy and Multi-Token Prediction (MTP) layers for accelerated inference through native speculative decoding.
- โขNemotron 3 Ultra supports an expansive context length of up to 1 million tokens, which is critical for maintaining coherence and managing extensive information in long-running agentic workflows, such as analyzing large codebases or legal documents.
- โขNVIDIA has made the base, post-trained, and quantized checkpoints of Nemotron 3 Ultra, along with its training data and recipes, openly available on HuggingFace, fostering broader customization and development.
- โขThe model is optimized for integration with leading agent platforms and harnesses, including Hermes Agent, LangChain Deep Agents, OpenClaw, OpenHands, and OpenCode, indicating its design for practical, ecosystem-wide deployment in enterprise AI.
๐ Competitor Analysisโธ Show
| Metric/Model | NVIDIA Nemotron 3 Ultra | GLM-5.1-754B-A40B | Kimi-K2.6-1T-A32B | Qwen-3.5-397B-17B |
|---|---|---|---|---|
| Parameters | 550B total / 55B active (MoE) | 754B | 1T | 397B |
| Architecture | Hybrid Mamba-Attention MoE | N/A | N/A | N/A |
| Context Length | Up to 1M tokens | N/A (max 256K for Kimi/Qwen) | N/A (max 256K for Kimi/Qwen) | N/A (max 256K for Kimi/Qwen) |
| Inference Throughput (8K input / 64K output) | 5.9x higher than GLM-5.1, 4.8x higher than Kimi-K2.6, 1.6x higher than Qwen-3.5 | Baseline | Baseline | Baseline |
| Agent Productivity PinchBench | 91% | 84% | 91% | 89% |
| Long-horizon Planning EnterpriseOps-Gym | 33% | 40% | 29% | 30% |
| Coding Terminal-Bench 2.0 | 54% | 64% | 67% | 53% |
| Instruction Following IFBench | 82% | 77% | 74% | 78% |
| Long Context Ruler @1M | 95% | N/A (max 256K) | N/A (max 256K) | 90% |
| Pricing (OpenRouter) | $0 per million input/output tokens | N/A | N/A | N/A |
Note: Detailed feature comparisons and consistent pricing data for competitor models across all platforms were not readily available in the search results. Pricing for Nemotron 3 Ultra on OpenRouter is listed as free, implying infrastructure costs would be the primary expense when deployed on platforms like SageMaker JumpStart.
๐ ๏ธ Technical Deep Dive
- Parameter Count: 550 billion total parameters with 55 billion active parameters, utilizing a Mixture-of-Experts (MoE) architecture.
- Architecture Type: Hybrid Mamba-Attention Mixture-of-Experts (MoE) with interleaved Mamba-2 and MoE layers, along with select Attention layers.
- Key Technologies: Leverages LatentMoE for improved accuracy and efficient expert routing, and incorporates Multi-Token Prediction (MTP) layers for faster inference through native speculative decoding and improved generative speed.
- Quantization: Pre-trained using NVFP4 quantization, an NVIDIA 4-bit floating point format, to maximize compute efficiency and enable cross-architecture GPU deployment.
- Context Length: Supports an extensive context length of up to 1 million tokens, crucial for long-running and complex agentic tasks.
- Training Pipeline: Post-trained with an enhanced pipeline that includes Supervised Fine Tuning (SFT), Reinforcement Learning (RL), and Multi-teacher On-Policy Distillation (MOPD) for improved model accuracy.
- Optimization: Optimized for agent-led open harnesses and designed to excel in workflows involving planning, tool calling, observation reading, sub-agent delegation, output validation, and error recovery.
- Minimum GPU Requirements: Requires a minimum of 4xGB200, 4xB200, 4x GB300, 4x B300, or 8xH100 GPUs for deployment.
- Supported Languages: Supports English, French, Spanish, Italian, German, Japanese, Korean, Hindi, Brazilian Portuguese, and Chinese.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
NVIDIA's strategy of open-sourcing advanced models like Nemotron 3 Ultra will accelerate the adoption and innovation of agentic AI across enterprises.
By providing open weights, training data, and recipes, NVIDIA enables broader customization and integration, fostering a more robust ecosystem for AI agent development.
The integration of Nemotron 3 Ultra on Amazon SageMaker JumpStart will significantly lower the barrier to entry for enterprises to deploy sophisticated agentic AI solutions.
The one-click deployment and managed infrastructure offered by SageMaker JumpStart simplify the operational complexities associated with deploying large, complex AI models.
The focus on long-context and efficient agentic workflows with Nemotron 3 Ultra will drive a shift in enterprise AI applications towards more autonomous and multi-step reasoning systems.
The model's capabilities address critical challenges in long-running tasks, such as maintaining coherence and managing costs, which are essential for practical enterprise automation.
โณ Timeline
2023-11
NVIDIA introduced Nemotron-3 8B for enterprise chatbot and copilot development.
2025-12
NVIDIA launched the hybrid Nemotron 3 family, including Nemotron 3 Nano.
2026-02
NVIDIA Nemotron 3 Nano 30B model became generally available in Amazon SageMaker JumpStart.
2026-04
NVIDIA Nemotron-3-Super-120B model became available on Amazon SageMaker JumpStart.
2026-04
NVIDIA Nemotron 3 Nano Omni model became available on Amazon SageMaker JumpStart.
2026-06
NVIDIA Nemotron 3 Ultra launched on Amazon SageMaker JumpStart.
๐ Sources (15)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: AWS Machine Learning Blog โ