Skip to content
Sagan

Paper

$\phi$-Balancing for Mixture-of-Experts Training

Unreadunread

AI summary

arXiv:2605. 15403v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models rely on balanced expert utilization to fully realize their scalability.