Microsoft recruits key Ai2 researchers for Superintelligence team

๐กTop open-source talent from Ai2 joins Microsoft, signaling a potential shift in their AI research strategy.
โก 30-Second TL;DR
What Changed
Microsoft's Superintelligence team absorbed 10+ former Ai2 researchers.
Why It Matters
The migration of top-tier open-source talent to Microsoft suggests a potential shift in the company's internal research priorities toward more transparent or collaborative model architectures.
What To Do Next
Monitor the upcoming releases from Microsoft's Superintelligence team to see if they adopt open-data practices similar to the OLMo project.
Key Points
- โขMicrosoft's Superintelligence team absorbed 10+ former Ai2 researchers.
- โขThe hires include the core team responsible for the OLMo open-source model.
- โขAi2 is shifting its organizational focus toward applied AI use cases.
๐ง Deep Insight
Web-grounded analysis with 26 cited sources.
๐ Enhanced Key Takeaways
- โขMicrosoft's Superintelligence team, led by Mustafa Suleyman, is focused on developing 'Humanist Superintelligence' (HSI), which aims to create practical, problem-oriented AI systems for specific domains like healthcare, energy, and AI companions, explicitly distinguishing itself from the pursuit of unbounded Artificial General Intelligence (AGI).
- โขThe OLMo project, developed by Ai2, is notable for its commitment to 'truly open' AI, providing not only model weights and inference code but also comprehensive training data (Dolma dataset), training code, intermediate checkpoints, and detailed logs under an Apache 2.0 License, fostering unprecedented transparency and reproducibility for scientific research.
- โขThe departure of key Ai2 researchers, including former CEO Ali Farhadi and OLMo co-lead Hanna Hajishirzi, to Microsoft's Superintelligence team is partly linked to a strategic shift in Ai2's primary funding from Paul Allen's estate to the Fund for Science and Technology (FFST), which prioritizes applied AI research over the costly development of frontier models.
- โขDespite the staff departures, Ai2 has recently activated a new Nvidia-powered computing cluster as part of a $152 million initiative with the National Science Foundation (NSF) and Nvidia (Open Multimodal AI Infrastructure for Science, or OMAI) to build open multimodal AI models specifically for scientific research, reaffirming its dedication to open science and applied AI in specialized fields.
๐ ๏ธ Technical Deep Dive
- Architecture: OLMo models (e.g., OLMo-7B, OLMo-1B, OLMo 3 7B, OLMo 3 32B) are built upon a decoder-only transformer architecture, incorporating design elements from models like PaLM and Llama.
- Key Architectural Components:
- Exclusion of all bias terms.
- Non-parametric layer normalization.
- SwiGLU activation function.
- Rotary Positional Embeddings (RoPE), with scaling mechanisms to support context lengths up to 65,536 tokens in OLMo 3.
- A vocabulary size of 50,280.
- Training Data:
- Primarily trained on the Dolma dataset, a diverse, multi-source corpus.
- OLMo 3 is pretrained on Dolma 3, a ~9.3-trillion-token corpus, with a 5.9-trillion-token pretraining mix (Dolma 3 Mix) that includes web pages, scientific PDFs (processed with olmOCR), codebases, math problems, and encyclopedic text.
- Training data undergoes extensive deduplication, quality filtering, and careful control over data mixing.
- Training Methodology:
- Employs a staged training approach, including initial pretraining, mid-training with targeted high-quality data (Dolma 3 Dolmino), and long-context extension (Dolma 3 Longmino).
- OLMo-core, a custom training codebase built on PyTorch and FSDP, supports distributed training by sharding model parameters, gradients, and optimizer states across GPUs for efficiency.
- Intermediate checkpoints are saved frequently (e.g., every 1000 training steps) to enable scientific study and reproducibility.
- OLMo 3 doubled the context window during pre-training and mid-training to 8192 tokens and implemented a sliding window attention pattern on three out of four layers.
- Variants: The OLMo 3 family includes Base (7B, 32B), Think (7B, 32B) for reasoning, and Instruct (7B) for chat and instruction following.
- Transparency Tools: Ai2 provides OlmoTrace, a tool that allows users to trace model outputs back to specific pretraining data, enhancing transparency and understanding of model behavior.
- Efficiency: External analyses suggest OLMo 3's training is approximately 2.5 times more compute-efficient than Meta's Llama 3.1 8B baseline for comparable or superior performance on several benchmarks.
- Hybrid Architectures: Ai2 also released Olmo Hybrid in March 2026, a 7B-parameter model family that combines transformer attention with linear recurrent layers (Gated DeltaNet) for improved scaling and data efficiency, achieving the same MMLU accuracy as Olmo 3 with 49% fewer tokens.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (26)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
- Google Search Source
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: GeekWire โ