DeepGEMM Update Confirms mHC and Blackwell for V4

#matrix-mult#gpu-optimization#low-precisiondeepgemmdeepseekdeepgemmmhcblackwell

💡DeepGEMM update unlocks mHC + Blackwell/FP4 for V4—infra boost for open models

⚡ 30-Second TL;DR

What Changed

Integrates Manifold-constrained Hyper-connection (mHC)

Why It Matters

Enables faster inference on next-gen GPUs, boosting open-source efficiency. Positions DeepSeek ahead in hardware-software co-design for V4.

What To Do Next

Pull latest DeepGEMM from GitHub and benchmark mHC on Blackwell sims.

Who should care:Researchers & Academics

Background and context from public sources — not the original article. 4 sources cited.

•DeepGEMM requires NVIDIA SM90 or SM100 GPUs, Python 3.8+, C++20 compilers, and CUDA 12.3+ for SM90 support[4].
•Recent GitHub activity includes multiple CI builds for wheel deployment and fixes for pre-built wheels as of early 2026[4].
•mHC integration leverages CUTLASS/CUTE implementations for persistent batched GEMM operations on Blackwell[1][2][3].

•Block-scaled GEMM + amax on SM100 supports FP4/FP8 inputs with per-block scale factors SFA/SFB, dequantizing along K dimension, outputting full C and global amax[1].
•GEMM + SwiGLU fusion on SM100 offers quantized block-scaled mode for FP4/FP8 with tile shapes like mma_tiler_mn=(128,128) and cluster_shape_mn=(1,1)[2].
•Blackwell SM100 introduces tcgen05.mma instructions, 2x-4x faster than Hopper WGMMA, supporting block-scaled MMA for mxf4nvf4 with tile shapes like 128x128x128 or 256x256x128[3].

DeepSeek V4 will achieve 2x-4x GEMM speedup on Blackwell vs Hopper

tcgen05.mma instructions in SM100 provide this performance uplift over Hopper WGMMA for low-precision block-scaled operations[3].

DeepGEMM enables FP4 training/inference for V4 on SM100

Library adds early FP4 support integrated with cuDNN Frontend's block-scaled GEMM fusions for Blackwell[1][4].

2025-12

DeepGEMM initial release for SM90 FP8 GEMM kernels

2026-01

CI fixes and wheel builds added to DeepGEMM repo

2026-02

Update integrates mHC, Blackwell SM100, and FP4 support

Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.

Weekly AI Recap

Read this week's curated digest of top AI events →

Same topic

Explore #matrix-mult

Same product