Skip to content
Sagan

Paper

Geometric Asymmetry in MoE Specialization: Functional Decorrelation and Representational Overlap

Unreadunread

AI summary

arXiv:2605. 16349v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures achieve scalable capacity through sparse routing, yet the geometric structure of expert specialization remains poorly understood.