๐ŸงStalecollected in 53m

Microsoft recruits key Ai2 researchers for Superintelligence team

Microsoft recruits key Ai2 researchers for Superintelligence team
PostLinkedIn
๐ŸงRead original on GeekWire

๐Ÿ’กTop open-source talent from Ai2 joins Microsoft, signaling a potential shift in their AI research strategy.

โšก 30-Second TL;DR

What Changed

Microsoft's Superintelligence team absorbed 10+ former Ai2 researchers.

Why It Matters

The migration of top-tier open-source talent to Microsoft suggests a potential shift in the company's internal research priorities toward more transparent or collaborative model architectures.

What To Do Next

Monitor the upcoming releases from Microsoft's Superintelligence team to see if they adopt open-data practices similar to the OLMo project.

Who should care:Researchers & Academics

Key Points

  • โ€ขMicrosoft's Superintelligence team absorbed 10+ former Ai2 researchers.
  • โ€ขThe hires include the core team responsible for the OLMo open-source model.
  • โ€ขAi2 is shifting its organizational focus toward applied AI use cases.

๐Ÿง  Deep Insight

Web-grounded analysis with 26 cited sources.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขMicrosoft's Superintelligence team, led by Mustafa Suleyman, is focused on developing 'Humanist Superintelligence' (HSI), which aims to create practical, problem-oriented AI systems for specific domains like healthcare, energy, and AI companions, explicitly distinguishing itself from the pursuit of unbounded Artificial General Intelligence (AGI).
  • โ€ขThe OLMo project, developed by Ai2, is notable for its commitment to 'truly open' AI, providing not only model weights and inference code but also comprehensive training data (Dolma dataset), training code, intermediate checkpoints, and detailed logs under an Apache 2.0 License, fostering unprecedented transparency and reproducibility for scientific research.
  • โ€ขThe departure of key Ai2 researchers, including former CEO Ali Farhadi and OLMo co-lead Hanna Hajishirzi, to Microsoft's Superintelligence team is partly linked to a strategic shift in Ai2's primary funding from Paul Allen's estate to the Fund for Science and Technology (FFST), which prioritizes applied AI research over the costly development of frontier models.
  • โ€ขDespite the staff departures, Ai2 has recently activated a new Nvidia-powered computing cluster as part of a $152 million initiative with the National Science Foundation (NSF) and Nvidia (Open Multimodal AI Infrastructure for Science, or OMAI) to build open multimodal AI models specifically for scientific research, reaffirming its dedication to open science and applied AI in specialized fields.

๐Ÿ› ๏ธ Technical Deep Dive

  • Architecture: OLMo models (e.g., OLMo-7B, OLMo-1B, OLMo 3 7B, OLMo 3 32B) are built upon a decoder-only transformer architecture, incorporating design elements from models like PaLM and Llama.
  • Key Architectural Components:
    • Exclusion of all bias terms.
    • Non-parametric layer normalization.
    • SwiGLU activation function.
    • Rotary Positional Embeddings (RoPE), with scaling mechanisms to support context lengths up to 65,536 tokens in OLMo 3.
    • A vocabulary size of 50,280.
  • Training Data:
    • Primarily trained on the Dolma dataset, a diverse, multi-source corpus.
    • OLMo 3 is pretrained on Dolma 3, a ~9.3-trillion-token corpus, with a 5.9-trillion-token pretraining mix (Dolma 3 Mix) that includes web pages, scientific PDFs (processed with olmOCR), codebases, math problems, and encyclopedic text.
    • Training data undergoes extensive deduplication, quality filtering, and careful control over data mixing.
  • Training Methodology:
    • Employs a staged training approach, including initial pretraining, mid-training with targeted high-quality data (Dolma 3 Dolmino), and long-context extension (Dolma 3 Longmino).
    • OLMo-core, a custom training codebase built on PyTorch and FSDP, supports distributed training by sharding model parameters, gradients, and optimizer states across GPUs for efficiency.
    • Intermediate checkpoints are saved frequently (e.g., every 1000 training steps) to enable scientific study and reproducibility.
    • OLMo 3 doubled the context window during pre-training and mid-training to 8192 tokens and implemented a sliding window attention pattern on three out of four layers.
  • Variants: The OLMo 3 family includes Base (7B, 32B), Think (7B, 32B) for reasoning, and Instruct (7B) for chat and instruction following.
  • Transparency Tools: Ai2 provides OlmoTrace, a tool that allows users to trace model outputs back to specific pretraining data, enhancing transparency and understanding of model behavior.
  • Efficiency: External analyses suggest OLMo 3's training is approximately 2.5 times more compute-efficient than Meta's Llama 3.1 8B baseline for comparable or superior performance on several benchmarks.
  • Hybrid Architectures: Ai2 also released Olmo Hybrid in March 2026, a 7B-parameter model family that combines transformer attention with linear recurrent layers (Gated DeltaNet) for improved scaling and data efficiency, achieving the same MMLU accuracy as Olmo 3 with 49% fewer tokens.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

Microsoft will accelerate its development of proprietary, human-centric frontier AI models, reducing its reliance on external partners like OpenAI.
By acquiring a proven team with expertise in efficient, open-source model development, Microsoft gains significant in-house capability to pursue its 'Humanist Superintelligence' vision independently.
The open-source AI ecosystem will continue to see a divergence between 'truly open' models (like OLMo) and 'open-weight' models, with increased scrutiny on transparency in training data and methodology.
Ai2's commitment to full transparency with OLMo, including data, code, and checkpoints, sets a high bar that other open-source initiatives may be pressured to match to foster trust and scientific reproducibility.
Ai2 will increasingly focus its research on applied AI for scientific discovery and environmental challenges, leveraging its new computing infrastructure.
The strategic shift at Ai2 towards applied AI, coupled with the $152 million OMAI initiative and new computing cluster, indicates a clear direction for its future research efforts.

โณ Timeline

2014
Allen Institute for AI (Ai2) officially formed by Paul Allen.
2024-02-01
Ai2 releases OLMo, its first Open Language Model, emphasizing full transparency.
2025-11-06
Microsoft forms its MAI Superintelligence Team, led by Mustafa Suleyman, focusing on 'Humanist Superintelligence'.
2025-11-20
Ai2 launches OLMo 3, a family of 7B and 32B models, building on its open-source commitment.
2026-03-10
Ai2 announces Ali Farhadi will step down as CEO, replaced by Peter Clark (interim).
2026-03-23
Microsoft hires former Ai2 CEO Ali Farhadi, OLMo co-lead Hanna Hajishirzi, and other key researchers for its Superintelligence team.
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: GeekWire โ†—