๐ผPandailyโขFreshcollected in 2h
DeepSeek and Zhipu AI Pivot to Custom Silicon
#ai-chips#silicon#inference#vertical-integrationcustom-ai-inference-chipsdeepseekzhipu aiopenaianthropic
๐กMajor AI labs are moving to custom silicon; learn how vertical integration is reshaping the AI infrastructure landscape.
โก 30-Second TL;DR
What Changed
DeepSeek and Zhipu AI are developing in-house silicon to reduce dependency on external GPU suppliers.
Why It Matters
This trend signals a structural shift where AI labs become vertically integrated hardware companies to secure supply chain independence and cost efficiency.
What To Do Next
Monitor the hardware requirements of your current inference stack to identify if your workload could benefit from specialized hardware acceleration in the future.
Who should care:Founders & Product Leaders
Key Points
- โขDeepSeek and Zhipu AI are developing in-house silicon to reduce dependency on external GPU suppliers.
- โขThe move mirrors strategies adopted by OpenAI and Anthropic to control the full AI stack.
- โขCustom chips are expected to significantly lower long-term inference costs and improve latency for large-scale models.
๐ง Deep Insight
AI-generated analysis for this event.
๐ Enhanced Key Takeaways
- โขDeepSeek's silicon initiative is reportedly focused on 'domain-specific architecture' (DSA) designed specifically to accelerate Mixture-of-Experts (MoE) inference, which is central to their model efficiency strategy.
- โขZhipu AI has established a dedicated hardware subsidiary, often referred to in industry circles as 'Zhipu Core,' to handle the integration of chip design with their GLM (General Language Model) series.
- โขThe pivot is heavily influenced by the tightening of U.S. export controls on advanced AI chips, forcing Chinese labs to seek domestic alternatives to NVIDIA's H20 and Blackwell-series GPUs.
- โขBoth companies are leveraging RISC-V open-source architecture for their custom chip designs to bypass potential intellectual property restrictions and maintain long-term design flexibility.
- โขIndustry analysts note that these labs are collaborating with domestic Chinese foundries, such as SMIC, to ensure a localized supply chain for chip manufacturing, despite yield challenges at advanced nodes.
๐ Competitor Analysisโธ Show
| Feature | DeepSeek/Zhipu (Custom) | OpenAI (Project Orion/Custom) | Google (TPU v5p) | NVIDIA (H200/B200) |
|---|---|---|---|---|
| Primary Focus | MoE Inference Optimization | Full-Stack Integration | Cloud/TPU Ecosystem | General Purpose AI |
| Architecture | RISC-V / DSA | Proprietary / ASIC | Custom ASIC (TPU) | GPU (CUDA) |
| Supply Chain | Domestic (SMIC) | TSMC | TSMC | TSMC |
๐ ๏ธ Technical Deep Dive
- Focus on high-bandwidth memory (HBM) integration to resolve memory wall bottlenecks during large-scale MoE model inference.
- Implementation of custom interconnect protocols to replace NVLink, aiming to scale multi-chip clusters without relying on restricted Western technologies.
- Optimization of sparse computation kernels directly into the silicon logic to reduce the overhead of routing tokens in MoE architectures.
- Utilization of chiplet-based design strategies to improve yield rates when manufacturing at mature process nodes (e.g., 7nm or 14nm) instead of relying solely on leading-edge EUV lithography.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
Domestic Chinese AI labs will achieve a 30% reduction in inference cost-per-token by 2027.
Transitioning from general-purpose GPUs to domain-specific silicon eliminates the 'tax' of unused GPU features and optimizes power consumption for specific model architectures.
DeepSeek and Zhipu AI will open-source their hardware-software interface layers.
To compete with the CUDA ecosystem, these companies must foster a developer community that can write code for their proprietary silicon.
โณ Timeline
2023-06
Zhipu AI releases GLM-130B, signaling a shift toward large-scale model development.
2024-01
DeepSeek releases DeepSeek-MoE, establishing their technical focus on sparse model architectures.
2025-03
DeepSeek and Zhipu AI begin internal recruitment for specialized hardware engineering teams.
2026-02
Reports emerge of Chinese AI labs testing RISC-V based AI accelerators in private data centers.
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Pandaily โ