Switch language한국어
Back to the list

Moonshot AI Open-Sources MoonEP: A Perfectly Balanced Expert Parallelism Library for MoE Training

TL;DR AI

Key summary

2 min read
  1. Moonshot AI open-sourced MoonEP, an MIT-licensed expert-parallel library for Mixture-of-Experts training.

  2. MoonEP uses online-planned redundant experts, fused permute/unpermute, and static buffer shapes to keep loads balanced across ranks.

  3. The company says MoonEP is one of the components behind Kimi K3’s claimed 2.5x scaling-efficiency gain.

  4. MoonEP was released alongside Kimi K3 Open Day materials and two other infrastructure codebases.

Read the original