⚡雷峰网•Stalecollected in 7h
HiDream-O1-Image-Pro: 200B+ Parameter Native Multimodal Model Released
💡A 200B+ parameter native multimodal model challenging SOTA benchmarks with a unified architecture approach.
⚡ 30-Second TL;DR
What Changed
Released 200B+ parameter closed-source model HiDream-O1-Image-Pro based on UiT architecture.
Why It Matters
The shift toward 'native multimodal' architectures suggests a move away from modular, stitched-together models toward unified world models capable of better physical reasoning and spatial understanding.
What To Do Next
Evaluate the HiDream-O1-Image-Pro capabilities for your high-fidelity text-to-image workflows, especially if you require precise text rendering and complex multi-subject composition.
Who should care:Developers & AI Engineers
Key Points
- •Released 200B+ parameter closed-source model HiDream-O1-Image-Pro based on UiT architecture.
- •Achieved SOTA performance in text rendering, multi-subject personalization, and instruction-based editing.
- •Secured new round of funding from investors including CVCapital and Jinpu Investment.
- •Business strategy follows a '1+1+3' model: one base model, one middleware platform, and three core application scenarios.
🧠 Deep Insight
Web-grounded analysis with 18 cited sources.
🔑 Enhanced Key Takeaways
- •HiDream.ai was founded in March 2023 by Dr. Mei Tao, a former JD.com VP and 2025 ACM Fellow, and is headquartered in Beijing, China.
- •The company has secured over 500 million CNY (approximately $70M USD) in funding, with recent investors including Shenzhen Capital Group (SCGC), GP Capital (Jinpu Investment), Caixin Capital, Fuju Investment, Oriental Fortune Capital, Anhui Industrial Investment, and Fenghua Capital.
- •Prior to the 200B+ Pro model, HiDream.ai released an 8-billion-parameter open-source text-to-image model, HiDream-O1-Image (also referred to as HiDream-I1), which demonstrated superior performance over larger models like FLUX.2 [dev] (32B parameters) across multiple image quality benchmarks.
- •The Unified Transformer (UiT) architecture employed by HiDream-O1-Image-Pro represents a 'native full-modal' approach, aiming to overcome the limitations of fragmented architectures that rely on separate text encoders and external VAEs by integrating various modalities into a shared latent space.
- •HiDream.ai's product ecosystem extends beyond image generation to include HiDream-E1 for image editing, vivago.ai as a consumer AIGC platform, and PixMaker for marketing content, with plans to release a minute-long video generation model capable of synchronized audio and visual output.
📊 Competitor Analysis▸ Show
| Feature/Benchmark | HiDream-O1-Image (8B) | FLUX.2 [dev] (32B) | DALL-E 3 | Ideogram v3 |
|---|---|---|---|---|
| Parameter Count | 8 Billion | 32 Billion | Proprietary | Proprietary |
| Architecture | Pixel-level Unified Transformer (UiT), no VAE | Diffusion Transformer (implied VAE) | Proprietary | Proprietary |
| License | MIT (Open Weights) | Developer Version | Proprietary | Proprietary |
| GenEval (overall) | 0.90 | 0.87 | - | - |
| DPG-Bench (overall) | 89.83 | 87.57 | 83.50 | - |
| HPSv3 (overall) | 10.37 | 9.28 | - | - |
| CVTG-2K (average) | 0.9128 | 0.8926 | - | - |
| LongText-EN | 0.979 | 0.963 | - | - |
| LongText-ZH | 0.978 | 0.757 | - | - |
| Text Rendering | SOTA performance | - | - | Strong on text rendering and typography |
| Image Generation | SOTA performance | - | - | - |
| Multi-task Editing | SOTA performance | - | - | - |
Note: The HiDream-O1-Image-Pro (200B+) is a closed-source model that has reportedly surpassed mainstream open-source models like Z-Image Turbo, Qwen-Image, and FLUX.2 [dev] in benchmarks, but specific comparative scores for the Pro version are not publicly detailed.
🛠️ Technical Deep Dive
- Unified Transformer (UiT) Architecture: HiDream-O1-Image-Pro is built on a new generation native full-modal UiT architecture, which aims to provide a unified modeling framework for images, videos, text, audio, and potentially action and embodied data.
- Pixel-space Diffusion Transformer: The architecture pioneers a paradigm shift from modular designs (relying on disjoint text encoders and external VAEs) to an end-to-end in-context visual generation engine, specifically using a pixel-space Diffusion Transformer that removes the VAE bottleneck.
- Scalability: The architecture has been successfully scaled up to over 200 billion parameters for the HiDream-O1-Image-Pro, demonstrating immense scalability.
- HiDream-I1 (8B/17B) Architectural Insights (predecessor/related model):
- Employs a Mixture of Experts (MoE) architecture within its Diffusion Transformer (DiT) backbone, combining dual-flow MMDiT blocks with single-flow DiT blocks for efficient resource allocation via dynamic routing.
- Integrates multiple text encoders, including OpenCLIP ViT-bigG, OpenAI CLIP ViT-L, T5-XXL, and Llama-3.1-8B-Instruct, to significantly enhance semantic understanding.
- Features a dual-stream then single-stream design for cross-attention: image latent tokens and text tokens are processed in parallel before merging into a single stream where a unified transformer layer attends over the concatenated sequence.
- Conditioning, such as pooled CLIP embeddings and diffusion timesteps, is injected via adaptive layer normalization (AdaLN) in each transformer block.
- The 8B model supports native generation up to 2048x2048 pixels.
🔮 Future ImplicationsAI analysis grounded in cited sources
HiDream.ai's 'native full-modal' UiT architecture could become a foundational approach for next-generation multimodal AI.
By unifying various modalities into a single framework and addressing the limitations of fragmented architectures, it aims to enable more comprehensive 'world modeling' capabilities, potentially influencing future AI development.
The company's strategic focus on enterprise-focused intelligent agents and global market expansion indicates a strong push for broad commercial adoption beyond creative content generation.
Recent funding rounds are specifically allocated for the research and development of next-generation native multimodal world models, enterprise service intelligent agents, and global market expansion, signaling a move towards diverse industrial applications.
⏳ Timeline
2023-03
HiDream.ai founded by Dr. Mei Tao.
2023-12
HiDream.ai receives funding led by iFLYTEK CO.,LTD.
2024-05
HiDream.ai launches the world's first publicly available DiT-architecture video generation model.
2025-04
HiDream.ai officially open-sources HiDream-I1, a 17-billion-parameter text-to-image model.
2026-04
HiDream.ai closes a new funding round exceeding 500 million yuan (approx. $70M USD).
2026-05
HiDream.ai releases the 8-billion-parameter open-source HiDream-O1-Image model and its technical report, and officially releases the 200B+ parameter closed-source HiDream-O1-Image-Pro model, announcing another round of hundred-million-level financing.
📎 Sources (18)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
📰
Weekly AI Recap
Read this week's curated digest of top AI events →
👉Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: 雷峰网 ↗