Nvidia Removes Rug-Pull from Nemotron License

🔑 Enhanced Key Takeaways

• •Nemotron 3 Super features a hybrid Mamba2-Transformer architecture with LatentMoE, activating only 12B of its 120B parameters during inference for 4x higher efficiency[3][4][6].
• •Model trained on over 10 trillion tokens of synthetic data with post-training cutoff in February 2026, including 21 RL environments and full recipes published for reproducibility[3][4][6].
• •Available on Hugging Face, build.nvidia.com, Perplexity, OpenRouter, and partners like Google Cloud Vertex AI, Oracle OCI, with self-hosting requiring 8x H100 GPUs minimum[3][4][5].

🛠️ Technical Deep Dive

• •Architecture: Mamba2-Transformer Hybrid Latent Mixture of Experts (LatentMoE) with Multi-Token Prediction (MTP); 120B total parameters, 12B active at inference[3][4][6].
• •Optimizations: Native NVFP4 pretraining for Blackwell GPUs (4x inference speedup vs FP8 on H100); hybrid backbone with Mamba for efficiency and Transformers for reasoning[4][6].
• •Training: Pre-training data cutoff June 2025, post-training February 2026; multi-environment RL with 1.2M rollouts across 21 configs using NeMo Gym/RL[4][6].
• •Hardware: Compatible with NVIDIA Ampere A100, Hopper H100-80GB, Blackwell; runtime NeMo 25.11.01 on Linux[4].
• •Performance: 85.6% on PinchBench for agentic tasks; configurable reasoning mode via chat template[4][6].

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline