DeepSeek Proposes DeepGEMM Update With Mega MoE and FP4 Indexer

The “Public release 26/04” merge request supports FP8 x FP4 MoE (mixture-of-experts model routing) with EP≤8 and requires PyTorch 2.9 or higher.

46d ago